-- Logs begin at Thu 2022-05-12 11:02:35 UTC, end at Thu 2022-05-12 12:06:59 UTC. -- May 12 11:30:11.155487 dv-cinder-804735-29-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 11:30:11.164845 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 11:30:11 2022] *** May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: nodename: dv-cinder-804735-29-iscsi May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: machine: x86_64 May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: clock source: unix May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: pcre jit disabled May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: detected number of CPU cores: 4 May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: current working directory: / May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: detected binary path: /usr/bin/uwsgi-core May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: your processes number limit is 47680 May 12 11:30:11.166854 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: your memory page size is 4096 bytes May 12 11:30:11.167486 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: detected max file descriptor number: 2048 May 12 11:30:11.167486 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: lock engine: pthread robust mutexes May 12 11:30:11.167486 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: thunder lock: enabled May 12 11:30:11.167486 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 11:30:11.167486 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 11:30:11.211869 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: Python main interpreter initialized at 0x558b78a429c0 May 12 11:30:11.211869 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: python threads support enabled May 12 11:30:11.211869 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: your server socket listen backlog is limited to 100 connections May 12 11:30:11.211869 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: your mercy for graceful operations on workers is 90 seconds May 12 11:30:11.212193 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: mapped 403077 bytes (393 KB) for 2 cores May 12 11:30:11.212396 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: *** Operational MODE: preforking *** May 12 11:30:11.212589 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: *** uWSGI is running in multiple interpreter mode *** May 12 11:30:11.212589 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: spawned uWSGI master process (pid: 80079) May 12 11:30:11.215242 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: spawned uWSGI worker 1 (pid: 80119, cores: 1) May 12 11:30:11.215242 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: spawned uWSGI worker 2 (pid: 80120, cores: 1) May 12 11:30:11.215242 dv-cinder-804735-29-iscsi devstack@keystone.service[80079]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 11:30:11.212786 dv-cinder-804735-29-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 11:30:17.014597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:30:17.014597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: from cryptography.utils import int_from_bytes May 12 11:30:17.015983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:30:17.015983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: from cryptography.utils import int_from_bytes May 12 11:30:17.020908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:30:17.020908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: from cryptography.utils import int_from_bytes May 12 11:30:17.024747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:30:17.024747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: from cryptography.utils import int_from_bytes May 12 11:30:17.069998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 11:30:17.070466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 11:30:17.071335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] command line args: [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 11:30:17.071800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 11:30:17.072161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ================================================================================ {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 11:30:17.072594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] admin_token = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.073009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] config_dir = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.073372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.073862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] config_source = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.074213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] debug = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.074697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.074879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 11:30:17.074879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 11:30:17.075783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] command line args: [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 11:30:17.075783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 11:30:17.075783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ================================================================================ {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 11:30:17.076031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] admin_token = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] config_dir = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] config_source = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] debug = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.078416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.078498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.079081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] list_limit = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.079081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] log_config_append = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.079300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.079546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.079642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] log_dir = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.079887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] log_file = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.080099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.080297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.080647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.080742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.081057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.081277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.081479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.081853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] list_limit = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.082181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] log_config_append = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.082490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.082797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] log_dir = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.083105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] log_file = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.084109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.084702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.085089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.085479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.085995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.088471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.088471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.089257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.089866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.089866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.090319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.090478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.090710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.090930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.091032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.091276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.091510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.091609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.091781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.092031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.092124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.092392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.092552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.092851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.093031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.093154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.093794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.094080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] publish_errors = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.094182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.094259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] publish_errors = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.094829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.095064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.095248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.095337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.095601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.095694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.095866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.096117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.096216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.096368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] standard_threads = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.096554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.096851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.096945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] standard_threads = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.097112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.097296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.097388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.097504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] use_journal = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.097654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] use_json = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.097774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.097859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] use_stderr = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.098038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] use_syslog = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.098193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.098282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.098531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] use_journal = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.098624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.098770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.098941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] use_json = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.099028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.099270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.099371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] use_stderr = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.099524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.099686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] use_syslog = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.099773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.100088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:30:17.100234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.100464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.100554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.100729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.100813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.100986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.101130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.101246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.101448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.101540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.101775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.101867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.102028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.102203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.102329 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.102513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.102636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.102752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.102960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.103087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.103251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.103378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.103494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.103726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.103865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.103982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.104156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.104278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.104476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.104598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.104721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.104906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.105030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.105169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.105286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.105407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.105868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.106002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.106002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.106206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.107221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.107354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.107473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.107589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.107589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.107811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.107931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.108726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.109944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.110070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.111932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.112046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.112159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.112284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.112284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.112515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.112630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.113936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.114099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.114099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.114099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.114606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.114752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.114924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.115094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.115265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.115437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.115708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.115952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.115952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.116567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.116837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.117198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.117709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.117709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.118385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.118694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.118846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.119477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.119477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.119715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.120195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.120324 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.120441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.120574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.120820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.120938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.121037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.121133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.121548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.121548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.123759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.123929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.124071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.124288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.124435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.124588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.124720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.124852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.124994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.125941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.126185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.126314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.126468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.126602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.126731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.126860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.126989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.127124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.127262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.127393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.127393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.127634 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.127763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.127891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.128029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.130182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.130332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.130467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.130467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.130467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.130906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] auth.external = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.131983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.132112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.132250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.132250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.132250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.132610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.132748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.132886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] auth.password = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.133548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.133691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] auth.token = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.133936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.134976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.135110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.135250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.135380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.135517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.135647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.135775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.135904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] credential.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.136031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.136160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.136297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.136429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.136587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.136882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137425 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.137840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.138958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.140989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] auth.external = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] auth.password = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] auth.token = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.141128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] credential.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.142289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.143373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.143373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.143373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.143373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.143373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.143373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.144096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.144096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.144096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.144470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.144601 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.144732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.144869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.145000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.145136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.145136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.145383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.145519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.145725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.146788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.146946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.147081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.147212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.147212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.147472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.147605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.147748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.147878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.148008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.148146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.148284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.148284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.148284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.148284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.148284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.149439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.149439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.149439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.150248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.150248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.150501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.150639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.150780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.151048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.151539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.151699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.151831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.151961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.152101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.152238 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.152368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.152497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.152627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.152755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.152901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.153032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.153163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.153293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.153428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.153578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.153803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.153945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.154077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.154209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.154916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.155078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.155219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.155349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.155479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.155614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.155744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.155882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.156942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.157082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.157213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.157345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.157482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.157619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.157831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.157966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.158096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.158096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.158354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.158354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.158600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.158728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.159193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.159341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.159482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.159624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.159756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.159885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.160946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.161084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.161084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.161331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.161331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.161576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.161851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.162106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.162480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.162622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.162751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.162882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.163940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.164082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.164751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.164957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.165095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.165233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.165373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.165504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.165633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.165886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.166131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.166367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.166756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.166889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167570 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.167966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.168096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.168226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.168364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.168496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.168626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.168756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.168886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.169026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.169164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.169296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.169426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.169556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.169686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.169903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.170046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.170184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.170314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.170314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.170314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.170821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.171165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.171313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.171561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.171812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.172059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.172479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.172627 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.172759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.172890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.173021 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.173160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.173291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.173421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.173561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.173692 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.173863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.174005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.174005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.174254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.174459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.174714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.175019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.175276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.175518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.175761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.176000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] role.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.176993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] role.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.177162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.177307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.177440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.177571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.177735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.177877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.178008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.178151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.178284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.178426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.178558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.178688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.178688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.179009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.179009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.179009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.179374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.179505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.179635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.179779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.180447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.180583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.180713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.180843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.180973 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.181111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.181111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.181376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.181509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.181639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.181798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.181942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.182075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.182377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.182377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.182377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.182745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.182883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.183070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.183398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.183913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.184192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.184443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.184685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.184926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.185165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.185421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.185829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.185992 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.186126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.186257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.186388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.186518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.186650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.186799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.186932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.187967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.188211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.188349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.188490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.188490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.188735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.188865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.188995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.189132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.189269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.189404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.189540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.189671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.189838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.189997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.190129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.190129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.190384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.190384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.190384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.190751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.190884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] role.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] role.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.connection = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.191926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.192868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.193114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.193252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.193383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.193513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.193642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.193844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.193993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.194136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.194268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.194397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.194526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.194656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.194656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.194656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.195850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.196095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.196225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 11:30:17.196354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.196354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.196608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.196737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.196926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.197260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.197552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.198544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.198544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.198544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.199003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.199254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.199516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.199779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.200034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.200277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.200516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.200752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.200989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.201231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.201482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.201899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.204018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.204300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.204564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.204831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.205093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.205357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.205608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.206749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.206749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.206749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.207158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.207158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.207412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.207567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.207837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.connection = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.208087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.208341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.208583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.208829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.209068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.209309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.209548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.210729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.210729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.210729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.210729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.211275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.211275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.211543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.211675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.211891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.212134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.212372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:30:17.212544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 11:30:17.229766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.230292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.230725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.239869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.244461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.244697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.244927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.258617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.271625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.272055 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.279100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.279334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.329062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.329254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.382432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.382757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.383031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.383216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.450334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.450509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.450577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.450664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.450896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.450985 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.451049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.451110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.451285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.451370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.451503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.453628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.475879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.476060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.476137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.476236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.476360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.476606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.477294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.477397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.477550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.477634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.477754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.477826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.477999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.478185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.489129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.489403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.504359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.504755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.504853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.504919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.505972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.506148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 11:30:17.523564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.523736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 11:30:17.523968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.524056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.524190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 11:30:17.524273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 11:30:17.524500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.524585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.524729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 11:30:17.524810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.524954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.525036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.525215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.525310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.525472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.525739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.536173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.536453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.536750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.536848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.537030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.537172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.537312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.537559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.545186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.548505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.548787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.549185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.549469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.549773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.550037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.550196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.550336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.550563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.550830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.551112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.551378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.553545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.553860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.554268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.554555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.555375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.555640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.555912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.556186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.556584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.557089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.557572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.582424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.584100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.584432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.589793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.590072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.590350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.590513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.592153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.592436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.598011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.598179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.598323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.598465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.598669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.603420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.603706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.603986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.604263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.604531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.604799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.605065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.605331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.606552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.606834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.611503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.611789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.612068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.612347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.612618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.612885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.613149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.613413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.624553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.624832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.629420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.632535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.632874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.633092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.633384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.637379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.638365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.641006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.641293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.641936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.645621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.645944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.646226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.646377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.646520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.646769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.647040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.649869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.653575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.653894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.654171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.654448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.654722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.655000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.666551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.667132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.667591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.668024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.674543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.674929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.675199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.675466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.676262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.678007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.678279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.681902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.682181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.682461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.682742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.683017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.683929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.685647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.685946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.688995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.689273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.689556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.689872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.690148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.696533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.696811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.697089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.697376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.697653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.697958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.698230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.703622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.703900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.704176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.704466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.704742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.705022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.705293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.716354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.719910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.723272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.723688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.724882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.727046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.727323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.727518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.727611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.730844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.732599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.734253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.734531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.734820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.735041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.736645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.740058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.740493 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.740777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.741053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.742965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.744629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.747876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.748313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.748596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.748870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.750848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.751314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.751741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.758135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.758563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.758989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.759761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.760039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.760315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.760589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.760857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.761142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.761412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.761685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.761977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.762243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.762785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.763046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.763302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.766876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 11:30:17.767181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.767422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.767691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.767972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.768235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.768529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.768774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.769036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.769296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.769553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.769843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.770107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.770365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 11:30:17.803396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b78a429c0 pid: 80119 (default app) May 12 11:30:17.807573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8ddd-281f-449f-bd21-8d7eb669146a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:17.808015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8ddd-281f-449f-bd21-8d7eb669146a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:17.808305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8ddd-281f-449f-bd21-8d7eb669146a None None] PATH_INFO: `/v3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:17.810917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b78a429c0 pid: 80120 (default app) May 12 11:30:17.812638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Thu May 12 11:30:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:25.906920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ebe0c-70e7-4199-8c75-cf37a3c79964 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:25.907455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ebe0c-70e7-4199-8c75-cf37a3c79964 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:25.907455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ebe0c-70e7-4199-8c75-cf37a3c79964 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:25.912227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:25.917289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:25.917747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:25.917917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:25.949297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG oslo_db.sqlalchemy.engines [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:30:26.135700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG passlib.handlers.bcrypt [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80119) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 11:30:26.136124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG passlib.handlers.bcrypt [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80119) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 11:30:26.193307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:26.194900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:26.319720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 11:30:26.454783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ebe0c-70e7-4199-8c75-cf37a3c79964 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:26.489273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG oslo_db.sqlalchemy.engines [None req-331ebe0c-70e7-4199-8c75-cf37a3c79964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:30:26.616444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ebe0c-70e7-4199-8c75-cf37a3c79964 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:26.621003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296d6b8-906e-4d53-8f35-55f19a3c2384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:26.621662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d6b8-906e-4d53-8f35-55f19a3c2384 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:26.621974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d6b8-906e-4d53-8f35-55f19a3c2384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:26.622252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d6b8-906e-4d53-8f35-55f19a3c2384 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:26.631185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296d6b8-906e-4d53-8f35-55f19a3c2384 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:26.682184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c296d6b8-906e-4d53-8f35-55f19a3c2384 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 11:30:26.682531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296d6b8-906e-4d53-8f35-55f19a3c2384 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:26.693077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Thu May 12 11:30:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 11:30:26.698636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:26.713332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4a9f-2e5c-4448-b9c4-b7988896911b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:26.717959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06fb7-f59b-49f0-b2f7-e6ef0c41c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:26.719062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06fb7-f59b-49f0-b2f7-e6ef0c41c9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:26.719343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06fb7-f59b-49f0-b2f7-e6ef0c41c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:26.719615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06fb7-f59b-49f0-b2f7-e6ef0c41c9cc admin admin] PATH_INFO: `/v3/projects/11860b8464634d7683ecba74bb161400` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:26.721075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06fb7-f59b-49f0-b2f7-e6ef0c41c9cc admin admin] RBAC: Authorizing `identity:get_project(project_id=11860b8464634d7683ecba74bb161400)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:26.771128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING keystone.common.rbac_enforcer.enforcer [None req-35d06fb7-f59b-49f0-b2f7-e6ef0c41c9cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 11:30:26.771465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06fb7-f59b-49f0-b2f7-e6ef0c41c9cc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:26.775969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Thu May 12 11:30:26 2022] GET /identity/v3/projects/11860b8464634d7683ecba74bb161400 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:28.975070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded153b8-5ed9-40f3-9a02-cc615d1b5405 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:28.975553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded153b8-5ed9-40f3-9a02-cc615d1b5405 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:28.975553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded153b8-5ed9-40f3-9a02-cc615d1b5405 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:28.979678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:28.985218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1c2a3-8b45-4fc2-87e1-023fc56ec430 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:28.985637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1c2a3-8b45-4fc2-87e1-023fc56ec430 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:28.985839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1c2a3-8b45-4fc2-87e1-023fc56ec430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:29.005790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-91c1c2a3-8b45-4fc2-87e1-023fc56ec430 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:29.007303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-91c1c2a3-8b45-4fc2-87e1-023fc56ec430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:29.015282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 11:30:29.037580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded153b8-5ed9-40f3-9a02-cc615d1b5405 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:29.049686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded153b8-5ed9-40f3-9a02-cc615d1b5405 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:29.053911 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d0674-89b5-484a-a841-39a364b6782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:29.054537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0674-89b5-484a-a841-39a364b6782c admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:29.054823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0674-89b5-484a-a841-39a364b6782c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:29.055104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0674-89b5-484a-a841-39a364b6782c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:29.062668 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d0674-89b5-484a-a841-39a364b6782c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:29.064998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d0674-89b5-484a-a841-39a364b6782c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:29.073545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Thu May 12 11:30:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 11:30:29.078681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1c2a3-8b45-4fc2-87e1-023fc56ec430 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:29.088304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1c2a3-8b45-4fc2-87e1-023fc56ec430 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:29.092605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0040-296a-4e65-8790-b68f42317ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:29.093453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0040-296a-4e65-8790-b68f42317ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:29.093763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0040-296a-4e65-8790-b68f42317ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:29.094041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0040-296a-4e65-8790-b68f42317ec7 admin admin] PATH_INFO: `/v3/users/9c5320af9c1c4a2f890e539109dfa042` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:29.095436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0040-296a-4e65-8790-b68f42317ec7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c5320af9c1c4a2f890e539109dfa042)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:29.097261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0040-296a-4e65-8790-b68f42317ec7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:29.098849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Thu May 12 11:30:29 2022] GET /identity/v3/users/9c5320af9c1c4a2f890e539109dfa042 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:31.382218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7499ec-c4ce-4543-910b-7083603ec028 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:31.382757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7499ec-c4ce-4543-910b-7083603ec028 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:31.382757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7499ec-c4ce-4543-910b-7083603ec028 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:31.384114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:31.389171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8eacb-f1c6-4cf1-ab13-836dbbca2a35 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:31.389563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8eacb-f1c6-4cf1-ab13-836dbbca2a35 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:31.389739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8eacb-f1c6-4cf1-ab13-836dbbca2a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:31.415996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89f4f2-ee57-4344-a5e1-0d89257d0fc4 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:31.416287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89f4f2-ee57-4344-a5e1-0d89257d0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:31.416567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89f4f2-ee57-4344-a5e1-0d89257d0fc4 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:31.417984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:30:31.424146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed362-859e-4114-916a-25591e84069b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:31.424436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed362-859e-4114-916a-25591e84069b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:31.424720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed362-859e-4114-916a-25591e84069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:31.467380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG passlib.handlers.bcrypt [None req-580ed362-859e-4114-916a-25591e84069b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80120) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 11:30:31.467803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG passlib.handlers.bcrypt [None req-580ed362-859e-4114-916a-25591e84069b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80120) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 11:30:31.515029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-580ed362-859e-4114-916a-25591e84069b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:31.515632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-86c8eacb-f1c6-4cf1-ab13-836dbbca2a35 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:31.516674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-580ed362-859e-4114-916a-25591e84069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:31.516822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-86c8eacb-f1c6-4cf1-ab13-836dbbca2a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:31.595353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:31.618453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:31.620382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8eacb-f1c6-4cf1-ab13-836dbbca2a35 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:31.641134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed362-859e-4114-916a-25591e84069b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:31.723599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8eacb-f1c6-4cf1-ab13-836dbbca2a35 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:31.736922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed362-859e-4114-916a-25591e84069b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:31.756034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:31.756822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:31.757105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:31.757386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:31.768100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:31.768899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:31.769887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:31.770198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:31.770641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:31.779276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:31.780417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:31.781259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:31.786262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:31.839062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:31.840616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:31.880171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4d5a1-87a4-4189-af3a-69139c66a59a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:31.913009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:31.913609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:31.913919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:31.914198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:31.914952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:31.915260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:31.916649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:31.928529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:31.933978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:31.934211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:30:31.939471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:32.029566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021f39-0c65-4e61-a080-0b06746a18d3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:32.033804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818c3e-b45c-40ca-beec-7171ee6a5e28 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:32.067004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:32.067873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:32.068154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:32.068427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] PATH_INFO: `/v3/users/9c5320af9c1c4a2f890e539109dfa042` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:32.068519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:32.069347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:32.069636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] RBAC: Authorizing `identity:get_user(user_id=9c5320af9c1c4a2f890e539109dfa042)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:32.070304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:32.070581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:32.071127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:32.072750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:31 2022] GET /identity/v3/users/9c5320af9c1c4a2f890e539109dfa042 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:32.078084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:32.180938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a627421-e0c2-454b-b598-13fc57f50b2d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:32.196030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:32.197490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:32.213465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:32.214286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:32.214570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:32.214842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:32.216021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:32.217454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:30:32.218890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:32.219799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:32.220629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:30:32.220629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:30:32.220629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:30:32.220629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:32.220843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 10/18] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:32.220913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 9/19] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:30:32.225194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:32.226017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:32.318923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ff8d4-100e-493e-b196-251560327bdb None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:32.321617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fca2f-f252-4453-a908-50141374e394 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:32.352157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7fd1-040b-4c8e-9f90-a0ea4d701ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:32.352808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7fd1-040b-4c8e-9f90-a0ea4d701ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:32.353090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7fd1-040b-4c8e-9f90-a0ea4d701ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:32.353368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7fd1-040b-4c8e-9f90-a0ea4d701ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:32.354241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7fd1-040b-4c8e-9f90-a0ea4d701ba0 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.domain.id=default, user.id=9c5320af9c1c4a2f890e539109dfa042) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:32.354451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b12801-1aaa-4835-b8c0-024380786b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:32.354571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7fd1-040b-4c8e-9f90-a0ea4d701ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:32.355111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12801-1aaa-4835-b8c0-024380786b3c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:32.355393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12801-1aaa-4835-b8c0-024380786b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:32.355667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12801-1aaa-4835-b8c0-024380786b3c None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:32.355992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7fd1-040b-4c8e-9f90-a0ea4d701ba0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:32.356384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b12801-1aaa-4835-b8c0-024380786b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:32.356693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b12801-1aaa-4835-b8c0-024380786b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:32.358095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b12801-1aaa-4835-b8c0-024380786b3c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:32.363264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Thu May 12 11:30:32 2022] GET /identity/v3/role_assignments?user.id=9c5320af9c1c4a2f890e539109dfa042&scope.domain.id=default&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:32.377259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:35.024904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee75d5e-5bf3-470f-a845-003872a342ca None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.025411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee75d5e-5bf3-470f-a845-003872a342ca None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.025485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee75d5e-5bf3-470f-a845-003872a342ca None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.027136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:35.041406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d55b-b517-44a6-8bcc-efc88656255a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.041406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d55b-b517-44a6-8bcc-efc88656255a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.041406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d55b-b517-44a6-8bcc-efc88656255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.066669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-78f8d55b-b517-44a6-8bcc-efc88656255a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:35.068192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-78f8d55b-b517-44a6-8bcc-efc88656255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:35.175282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:35.227304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee75d5e-5bf3-470f-a845-003872a342ca None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:35.251923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfefc0-b35a-428b-8e1c-a179ae32a0da None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.252561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfefc0-b35a-428b-8e1c-a179ae32a0da None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.253048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfefc0-b35a-428b-8e1c-a179ae32a0da None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.254927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:35.260058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c89b2-0d16-4d81-bd50-34e6c2ca6f1b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.260622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c89b2-0d16-4d81-bd50-34e6c2ca6f1b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.261101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c89b2-0d16-4d81-bd50-34e6c2ca6f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.294953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-475c89b2-0d16-4d81-bd50-34e6c2ca6f1b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:35.296575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-475c89b2-0d16-4d81-bd50-34e6c2ca6f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:35.399470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee75d5e-5bf3-470f-a845-003872a342ca None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:35.488462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a3243-2f48-4221-ba4f-b6c304ac049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:35.489150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3243-2f48-4221-ba4f-b6c304ac049d None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.489500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3243-2f48-4221-ba4f-b6c304ac049d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.489809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3243-2f48-4221-ba4f-b6c304ac049d None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.490735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a3243-2f48-4221-ba4f-b6c304ac049d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:35.491988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 13/25] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:35.492217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a3243-2f48-4221-ba4f-b6c304ac049d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:35.539742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c89b2-0d16-4d81-bd50-34e6c2ca6f1b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:35.653194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 13/26] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 12 11:30:35 2022] POST /identity/v3/roles => generated 219 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:35.655681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddd7cf-e713-4a1a-81c9-aad07e0b4e99 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.656193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddd7cf-e713-4a1a-81c9-aad07e0b4e99 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.656699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddd7cf-e713-4a1a-81c9-aad07e0b4e99 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.658734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:35.660286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88f0d-d08d-4174-af34-0843e76240c6 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.660839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88f0d-d08d-4174-af34-0843e76240c6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.661314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88f0d-d08d-4174-af34-0843e76240c6 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.663394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 15/28] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:35.664972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79adc27-2403-43aa-a0b7-9435b96b90c1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.665483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79adc27-2403-43aa-a0b7-9435b96b90c1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.666059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79adc27-2403-43aa-a0b7-9435b96b90c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.711155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c79adc27-2403-43aa-a0b7-9435b96b90c1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:35.713109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c79adc27-2403-43aa-a0b7-9435b96b90c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:35.728179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c89b2-0d16-4d81-bd50-34e6c2ca6f1b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:35.777727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf628d-ffb4-41a0-af79-e919d9690cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:35.777727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf628d-ffb4-41a0-af79-e919d9690cae None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.777727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf628d-ffb4-41a0-af79-e919d9690cae None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.777727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf628d-ffb4-41a0-af79-e919d9690cae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.818496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf628d-ffb4-41a0-af79-e919d9690cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-d9cf628d-ffb4-41a0-af79-e919d9690cae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:35.830394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:35.831464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:35.832246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:35.841750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 14/29] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:30:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:35.843756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46930de1-aa94-4470-98d6-a60c6f821eff None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:35.844248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46930de1-aa94-4470-98d6-a60c6f821eff None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:35.844727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46930de1-aa94-4470-98d6-a60c6f821eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:35.856548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 16/30] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:35.857770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79adc27-2403-43aa-a0b7-9435b96b90c1 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:35.892056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-46930de1-aa94-4470-98d6-a60c6f821eff None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:35.902008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-46930de1-aa94-4470-98d6-a60c6f821eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:35.979723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 15/31] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:35.980513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46930de1-aa94-4470-98d6-a60c6f821eff None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:35.984859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79adc27-2403-43aa-a0b7-9435b96b90c1 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.030157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.031610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.032104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.032580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.033606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:36.034282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.036025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.046409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 17/32] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:36.047546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:36.087158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46930de1-aa94-4470-98d6-a60c6f821eff None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.125116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.126127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.126127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.126393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.127110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.128509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.168051 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e90a55-380c-4099-8858-3ac4a97b41f5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.204388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.205576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.206100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.206658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.219714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.221661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:30:36.242012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:36.242907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:36.243731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:30:36.243731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:30:36.243731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:30:36.243731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:36.246058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 18/33] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:36.253199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:36.266075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 16/34] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 12 11:30:35 2022] POST /identity/v3/roles => generated 225 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:36.266937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:36.373998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860d831-81e1-49be-8d00-c5628f9b6e58 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.382654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197e73b-4711-45fe-8d64-26c61865a6de None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.413813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.415078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.415595 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.416074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] PATH_INFO: `/v3/users/9c5320af9c1c4a2f890e539109dfa042` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.417812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] RBAC: Authorizing `identity:get_user(user_id=9c5320af9c1c4a2f890e539109dfa042)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.420862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.421250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.422057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.422409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.422758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.423639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:36.423811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 19/35] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:36 2022] GET /identity/v3/users/9c5320af9c1c4a2f890e539109dfa042 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:36.428812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.428812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.431551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:36.441481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 17/36] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:36.454961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:36.604439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b187-c1f5-4e54-9b6b-2ed5c6622e40 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.625913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b88e-7b3b-4134-9a33-067352592541 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.644013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb5e3-0fa6-4ab5-83a4-981e19e44c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.644685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb5e3-0fa6-4ab5-83a4-981e19e44c94 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.645010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb5e3-0fa6-4ab5-83a4-981e19e44c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.645294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb5e3-0fa6-4ab5-83a4-981e19e44c94 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.646357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb5e3-0fa6-4ab5-83a4-981e19e44c94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.647817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb5e3-0fa6-4ab5-83a4-981e19e44c94 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.660920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4687-99fe-4101-90c6-a6588983395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.661938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4687-99fe-4101-90c6-a6588983395b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.662228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4687-99fe-4101-90c6-a6588983395b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.662504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4687-99fe-4101-90c6-a6588983395b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.664143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4687-99fe-4101-90c6-a6588983395b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.665664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4687-99fe-4101-90c6-a6588983395b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.667944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 20/37] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:36.668576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174130f6-ce90-4488-9f99-51aa5c75ecb5 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.668864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174130f6-ce90-4488-9f99-51aa5c75ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.669143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174130f6-ce90-4488-9f99-51aa5c75ecb5 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.670489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 21/38] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:36.674171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174130f6-ce90-4488-9f99-51aa5c75ecb5 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:36.686156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 18/39] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:30:36 2022] POST /identity/v3/projects => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:36.687542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffec1d-5e50-4983-8c0f-5f04bd6b6cac None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.687914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffec1d-5e50-4983-8c0f-5f04bd6b6cac None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.688169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffec1d-5e50-4983-8c0f-5f04bd6b6cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.712745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d0ffec1d-5e50-4983-8c0f-5f04bd6b6cac None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:36.715035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d0ffec1d-5e50-4983-8c0f-5f04bd6b6cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:36.805185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 19/40] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:36.806818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6410-dffd-4665-ac2d-7b5ffba54e39 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.807250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6410-dffd-4665-ac2d-7b5ffba54e39 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.807675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6410-dffd-4665-ac2d-7b5ffba54e39 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.809434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 20/41] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:36.816083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07879-f968-4c81-934b-dfbaa412288c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.816740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174130f6-ce90-4488-9f99-51aa5c75ecb5 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:36.817161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07879-f968-4c81-934b-dfbaa412288c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.817688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07879-f968-4c81-934b-dfbaa412288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.837050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-93c07879-f968-4c81-934b-dfbaa412288c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:36.838741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-93c07879-f968-4c81-934b-dfbaa412288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:36.857471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:36.858483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:36.858770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:36.859048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] PATH_INFO: `/v3/domains/default/users/9c5320af9c1c4a2f890e539109dfa042/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:36.861130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9c5320af9c1c4a2f890e539109dfa042, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:36.862628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:36.880280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 22/42] 10.222.0.58 () {58 vars in 1361 bytes} [Thu May 12 11:30:36 2022] PUT /identity/v3/domains/default/users/9c5320af9c1c4a2f890e539109dfa042/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:30:36.881112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:36.934346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 21/43] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:36.958793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c07879-f968-4c81-934b-dfbaa412288c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:37.015204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602c3c7-3a4a-4c6d-abf2-09b13533ff47 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:37.051561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:37.052241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:37.052521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:37.052801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:37.053570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:37.055078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:37.067680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c07879-f968-4c81-934b-dfbaa412288c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:37.070492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 12 11:30:36 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:37.108191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b9e6b-b9c7-463e-b509-728c0bc57037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:37.109014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9e6b-b9c7-463e-b509-728c0bc57037 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:37.109384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9e6b-b9c7-463e-b509-728c0bc57037 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:37.109769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9e6b-b9c7-463e-b509-728c0bc57037 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:37.111132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b9e6b-b9c7-463e-b509-728c0bc57037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:37.112630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b9e6b-b9c7-463e-b509-728c0bc57037 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:37.117730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 22/45] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:37.120196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:37.227600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc6050-3804-470c-a9bb-ac6cdd1f674d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:37.262264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab9f5-073d-4c6a-a492-c0e2a9b17f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:37.262960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab9f5-073d-4c6a-a492-c0e2a9b17f6e None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:37.263780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab9f5-073d-4c6a-a492-c0e2a9b17f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:37.264061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab9f5-073d-4c6a-a492-c0e2a9b17f6e None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:37.264785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ab9f5-073d-4c6a-a492-c0e2a9b17f6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:37.266289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ab9f5-073d-4c6a-a492-c0e2a9b17f6e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:37.295863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:30:37 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:39.165932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e955b2b-1379-42f7-973e-01611bb96338 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.166470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e955b2b-1379-42f7-973e-01611bb96338 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.166470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e955b2b-1379-42f7-973e-01611bb96338 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.172154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 23/47] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:30:39.173914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099479-59ef-469b-8723-e1059ba2f877 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.174321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099479-59ef-469b-8723-e1059ba2f877 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.174475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099479-59ef-469b-8723-e1059ba2f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.191883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3c099479-59ef-469b-8723-e1059ba2f877 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:39.193064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3c099479-59ef-469b-8723-e1059ba2f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:39.268561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 25/48] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:39.291052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e955b2b-1379-42f7-973e-01611bb96338 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:39.400134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e955b2b-1379-42f7-973e-01611bb96338 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:39.435056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aea6b-5c8e-43eb-b77d-51ddbcbf4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:39.436165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aea6b-5c8e-43eb-b77d-51ddbcbf4360 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.436666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aea6b-5c8e-43eb-b77d-51ddbcbf4360 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.437153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aea6b-5c8e-43eb-b77d-51ddbcbf4360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.447811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aea6b-5c8e-43eb-b77d-51ddbcbf4360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-ea5aea6b-5c8e-43eb-b77d-51ddbcbf4360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:39.456247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:39.457161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:39.457972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 24/49] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:39.463568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099479-59ef-469b-8723-e1059ba2f877 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:39.528128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ed18-26d2-4d62-aaa4-db52ae0f62c3 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.528430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ed18-26d2-4d62-aaa4-db52ae0f62c3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.528709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ed18-26d2-4d62-aaa4-db52ae0f62c3 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.530125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 25/50] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:30:39.535107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9ba67-689e-458c-ac4d-4a1550f25b3e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.535389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9ba67-689e-458c-ac4d-4a1550f25b3e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.535669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9ba67-689e-458c-ac4d-4a1550f25b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.555884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d0f9ba67-689e-458c-ac4d-4a1550f25b3e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:39.557033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d0f9ba67-689e-458c-ac4d-4a1550f25b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:39.569530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099479-59ef-469b-8723-e1059ba2f877 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:39.604869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:39.605545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.606484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.606774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.607541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:39.607854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:39.609257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:39.617939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 26/51] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:39.623029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:39.631731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 26/52] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:39.655745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9ba67-689e-458c-ac4d-4a1550f25b3e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:39.729251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636237b6-4e67-4dad-a88a-16c2bbf11d58 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:39.759746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9ba67-689e-458c-ac4d-4a1550f25b3e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:39.765345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:39.766348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.766627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.766897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] PATH_INFO: `/v3/users/9c5320af9c1c4a2f890e539109dfa042` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.768244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] RBAC: Authorizing `identity:get_user(user_id=9c5320af9c1c4a2f890e539109dfa042)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:39.770099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:39.771886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:39 2022] GET /identity/v3/users/9c5320af9c1c4a2f890e539109dfa042 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:39.777207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:39.801692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:39.804066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.804359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.804643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.805897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:39.807629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:39.810051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 27/54] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:39.815650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:39.881974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7229-0855-4bc5-90c4-03db6b0207b8 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:39.927515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:39.928312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.928599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.928698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef90cbd-5297-4c15-93e4-01af8495312f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:39.928883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.930087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:39.931548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:39.933740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:39.948193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:39.965454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57fdc-7775-4196-8da0-8ee2d1ce1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:39.966397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57fdc-7775-4196-8da0-8ee2d1ce1dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:39.966688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57fdc-7775-4196-8da0-8ee2d1ce1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:39.966958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57fdc-7775-4196-8da0-8ee2d1ce1dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:39.967675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57fdc-7775-4196-8da0-8ee2d1ce1dc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:39.969108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57fdc-7775-4196-8da0-8ee2d1ce1dc7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:39.997948 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 28/56] 10.222.0.58 () {60 vars in 1140 bytes} [Thu May 12 11:30:39 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:40.056007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807ca13-0322-4b85-b1bf-6e615b6a5468 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:40.094405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ee6ff-8a7d-4503-8211-471823645a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:40.095370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ee6ff-8a7d-4503-8211-471823645a95 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:40.095878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ee6ff-8a7d-4503-8211-471823645a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:40.096325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ee6ff-8a7d-4503-8211-471823645a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:40.097411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ee6ff-8a7d-4503-8211-471823645a95 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.domain.id=default, user.id=9c5320af9c1c4a2f890e539109dfa042) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:40.097934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ee6ff-8a7d-4503-8211-471823645a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:40.100114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ee6ff-8a7d-4503-8211-471823645a95 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:40.107413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1322 bytes} [Thu May 12 11:30:39 2022] GET /identity/v3/role_assignments?user.id=9c5320af9c1c4a2f890e539109dfa042&scope.domain.id=default&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:42.281506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348cc45-5ae2-4ce3-b2eb-196ed03ab84a None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:42.282029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348cc45-5ae2-4ce3-b2eb-196ed03ab84a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:42.282127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348cc45-5ae2-4ce3-b2eb-196ed03ab84a None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:42.283495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 29/58] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:42.289004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477932f-4913-4b67-89d1-d45d29664b43 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:42.289410 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477932f-4913-4b67-89d1-d45d29664b43 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:42.289557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477932f-4913-4b67-89d1-d45d29664b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:42.306274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7477932f-4913-4b67-89d1-d45d29664b43 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:42.307555 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7477932f-4913-4b67-89d1-d45d29664b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:42.374069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 30/59] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:42.399203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348cc45-5ae2-4ce3-b2eb-196ed03ab84a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:42.499930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348cc45-5ae2-4ce3-b2eb-196ed03ab84a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:42.536306 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce604-3c0c-46e9-b6c2-22d0ad751936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:42.537039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce604-3c0c-46e9-b6c2-22d0ad751936 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:42.537321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce604-3c0c-46e9-b6c2-22d0ad751936 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:42.537597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce604-3c0c-46e9-b6c2-22d0ad751936 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:42.538822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ce604-3c0c-46e9-b6c2-22d0ad751936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:42.540273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ce604-3c0c-46e9-b6c2-22d0ad751936 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:42.541919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 30/60] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:42.549608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477932f-4913-4b67-89d1-d45d29664b43 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:42.647079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477932f-4913-4b67-89d1-d45d29664b43 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:42.680975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70772c-db9a-42ce-b6fd-c7e59719bbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:42.681648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70772c-db9a-42ce-b6fd-c7e59719bbad None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:42.686074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70772c-db9a-42ce-b6fd-c7e59719bbad None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:42.686074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70772c-db9a-42ce-b6fd-c7e59719bbad None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:42.686074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70772c-db9a-42ce-b6fd-c7e59719bbad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:42.686074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70772c-db9a-42ce-b6fd-c7e59719bbad None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:42.716653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 31/61] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:30:42 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:46.282544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b45c5-ef93-4a9a-9136-9cfd25365607 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.282544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b45c5-ef93-4a9a-9136-9cfd25365607 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.282544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b45c5-ef93-4a9a-9136-9cfd25365607 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.283591 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 31/62] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:46.289265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049dfb-eb01-4297-b36e-257ade08fd74 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.290205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049dfb-eb01-4297-b36e-257ade08fd74 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.290732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049dfb-eb01-4297-b36e-257ade08fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.309334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-af049dfb-eb01-4297-b36e-257ade08fd74 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:46.310931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-af049dfb-eb01-4297-b36e-257ade08fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:46.368399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ac68-d957-454c-90af-0033601f58ce None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.371933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ac68-d957-454c-90af-0033601f58ce None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.372454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ac68-d957-454c-90af-0033601f58ce None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.374607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:46.385324 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc25b-1830-41c4-861a-68bfb357d872 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.385961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc25b-1830-41c4-861a-68bfb357d872 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.388111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc25b-1830-41c4-861a-68bfb357d872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.414939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b12bc25b-1830-41c4-861a-68bfb357d872 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:46.415396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 32/64] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:46.416906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b12bc25b-1830-41c4-861a-68bfb357d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:46.479359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049dfb-eb01-4297-b36e-257ade08fd74 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:46.511836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 33/65] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:46.568258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc25b-1830-41c4-861a-68bfb357d872 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:46.657552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049dfb-eb01-4297-b36e-257ade08fd74 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:46.716408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:46.717449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.717902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.718338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.738448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:46.748566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:46.749461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:46.750444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:46.752752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 33/66] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:46.758935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:46.811701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc25b-1830-41c4-861a-68bfb357d872 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:46.877074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65e778-8a1d-430a-86e8-719cf12142c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:46.878348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65e778-8a1d-430a-86e8-719cf12142c2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.878774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65e778-8a1d-430a-86e8-719cf12142c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.879191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65e778-8a1d-430a-86e8-719cf12142c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.889843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65e778-8a1d-430a-86e8-719cf12142c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-cc65e778-8a1d-430a-86e8-719cf12142c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:46.897839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:46.898868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:46.899684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:46.902433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 34/67] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:46.903866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1c8c-2bfe-469f-8401-9cc5f38312a0 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.904350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1c8c-2bfe-469f-8401-9cc5f38312a0 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.904838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1c8c-2bfe-469f-8401-9cc5f38312a0 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.906578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 35/68] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:46.915972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1c8c-2bfe-469f-8401-9cc5f38312a0 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:46.923026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09df722-2e78-44ba-be93-1351041ea136 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:46.965272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679534d9-aaeb-48d3-8d6a-ef915af484dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:46.966710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679534d9-aaeb-48d3-8d6a-ef915af484dc None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.967203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679534d9-aaeb-48d3-8d6a-ef915af484dc None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.967997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679534d9-aaeb-48d3-8d6a-ef915af484dc None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:46.969239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679534d9-aaeb-48d3-8d6a-ef915af484dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:46.969860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679534d9-aaeb-48d3-8d6a-ef915af484dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:46.972209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679534d9-aaeb-48d3-8d6a-ef915af484dc None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:46.989236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:46.989236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441b58-2199-42c6-a978-195bf1aabbb3 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:46.989236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441b58-2199-42c6-a978-195bf1aabbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:46.989236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441b58-2199-42c6-a978-195bf1aabbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.012858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3b441b58-2199-42c6-a978-195bf1aabbb3 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:47.014999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3b441b58-2199-42c6-a978-195bf1aabbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:47.039109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1c8c-2bfe-469f-8401-9cc5f38312a0 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.080217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.081837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.082296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.082992 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.083889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:47.084518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.086799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.097787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 35/70] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:47.098948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441b58-2199-42c6-a978-195bf1aabbb3 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.107325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:47.112791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.220651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441b58-2199-42c6-a978-195bf1aabbb3 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.226693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a6026-0d15-4927-af42-b998eeffbbe4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.256060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.257190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.257616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.258128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.262528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.263407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.263694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.263974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] PATH_INFO: `/v3/users/9c5320af9c1c4a2f890e539109dfa042` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.265413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] RBAC: Authorizing `identity:get_user(user_id=9c5320af9c1c4a2f890e539109dfa042)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.266907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.273259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 37/72] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/users/9c5320af9c1c4a2f890e539109dfa042 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:47.274098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.274413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.276118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.278096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:47.279091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.379764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a483df-bb95-4fa4-b014-bc8bbbc22372 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.387716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d84d2-a21c-42d1-9a3b-246a623fcbf1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.412162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.412972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.413258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.413537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.420672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c97b9-2b21-4e8a-b440-611b195a42bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.421316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c97b9-2b21-4e8a-b440-611b195a42bd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.421602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c97b9-2b21-4e8a-b440-611b195a42bd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.421909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c97b9-2b21-4e8a-b440-611b195a42bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.424409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:47.433005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:47.433936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:47.434759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 38/74] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:47.435406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.505653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c97b9-2b21-4e8a-b440-611b195a42bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.507189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c97b9-2b21-4e8a-b440-611b195a42bd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.537711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48446b-ae42-4a68-a58d-970df3107521 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.570390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae4f3-b5c7-4523-a48b-6c705eb0503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.571030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae4f3-b5c7-4523-a48b-6c705eb0503e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.571338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae4f3-b5c7-4523-a48b-6c705eb0503e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.571623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae4f3-b5c7-4523-a48b-6c705eb0503e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.605434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 37/75] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:30:47.606595 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864d21-3c34-4d8a-a961-ffe53e8bbfa8 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.606887 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864d21-3c34-4d8a-a961-ffe53e8bbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.607166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864d21-3c34-4d8a-a961-ffe53e8bbfa8 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.609738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 38/76] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:47.609738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864d21-3c34-4d8a-a961-ffe53e8bbfa8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.640347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae4f3-b5c7-4523-a48b-6c705eb0503e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.641849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae4f3-b5c7-4523-a48b-6c705eb0503e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.703748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864d21-3c34-4d8a-a961-ffe53e8bbfa8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.734664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 39/77] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:30:47.734900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2134fa7-26a3-47c0-aed7-1b51e3d8a565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.735533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134fa7-26a3-47c0-aed7-1b51e3d8a565 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.735896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134fa7-26a3-47c0-aed7-1b51e3d8a565 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.736014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3deeb-02c2-4661-8615-69c663b43a3f None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.736174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134fa7-26a3-47c0-aed7-1b51e3d8a565 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.736264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3deeb-02c2-4661-8615-69c663b43a3f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.736506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3deeb-02c2-4661-8615-69c663b43a3f None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.736974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2134fa7-26a3-47c0-aed7-1b51e3d8a565 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:47.737284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2134fa7-26a3-47c0-aed7-1b51e3d8a565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.741737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 40/78] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:47.741737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3deeb-02c2-4661-8615-69c663b43a3f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.741923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2134fa7-26a3-47c0-aed7-1b51e3d8a565 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.747770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 39/79] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:47.749088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae049-7171-475d-8232-52efce4aab7b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.749376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae049-7171-475d-8232-52efce4aab7b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.749650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae049-7171-475d-8232-52efce4aab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.765490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ef7ae049-7171-475d-8232-52efce4aab7b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:47.766634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ef7ae049-7171-475d-8232-52efce4aab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:47.834711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 40/80] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:47.835558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae049-7171-475d-8232-52efce4aab7b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.843388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3deeb-02c2-4661-8615-69c663b43a3f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.877396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2498be-9c33-4383-a040-0e33cfc55a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.878280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2498be-9c33-4383-a040-0e33cfc55a0f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.878569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2498be-9c33-4383-a040-0e33cfc55a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.878845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2498be-9c33-4383-a040-0e33cfc55a0f None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.880041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2498be-9c33-4383-a040-0e33cfc55a0f None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.881485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2498be-9c33-4383-a040-0e33cfc55a0f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.883221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 41/81] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:47.884938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290a91a-f431-40f4-ac02-59b9059c5ca5 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.885218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290a91a-f431-40f4-ac02-59b9059c5ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.885506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290a91a-f431-40f4-ac02-59b9059c5ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.903046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d290a91a-f431-40f4-ac02-59b9059c5ca5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:47.904235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d290a91a-f431-40f4-ac02-59b9059c5ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:47.936080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae049-7171-475d-8232-52efce4aab7b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:47.966473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 42/82] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:47.967283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290a91a-f431-40f4-ac02-59b9059c5ca5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:47.968678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:47.969534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:47.969846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:47.970122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:47.971312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:47.972763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:47.974667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 41/83] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:47.975226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.065271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290a91a-f431-40f4-ac02-59b9059c5ca5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.069516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030b79-3be8-4042-9fba-fed6463f786c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.097829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.098683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.098967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.099243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.100444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.101907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.102613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.103402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.103531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 43/84] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:48.104279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.105931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.106239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.116210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:48.123948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:48.124784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:48.125539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 42/85] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:48.126496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.198448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385a7c-6165-41db-82d8-64a8ef607277 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.226634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0fd6-2a3c-454d-bbb8-551c3e55907a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.230875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.231572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.231833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.232064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.232888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=9c5320af9c1c4a2f890e539109dfa042) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:48.233197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.234651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.242747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 44/86] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/role_assignments?user.id=9c5320af9c1c4a2f890e539109dfa042&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:48.243564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.285636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.286579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.286862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.287139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.288020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=a99077e3219448dd982cddd4372f35b3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:48.288332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.289866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.302002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 43/87] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/role_assignments?user.id=a99077e3219448dd982cddd4372f35b3&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:48.302002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.357109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c5284-c37e-4359-a0e8-e5998b877ae0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.396255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.397080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.397368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.397650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.398990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.400529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.402272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 45/88] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:48.403081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.411636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867220f-0cc2-4a1a-b415-62ce9373aa20 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.457074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.457775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.458064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.458343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.514907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7754662-71e0-4670-96d5-7d42913c5570 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.539517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.540996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.557728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.558915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.559650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.560117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.561043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:48.561524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.563883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.576366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 46/89] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:48.577381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.654152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 44/90] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:30:48.655789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.706635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d7307-a530-4af9-b4da-26246ff36539 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.751592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.753188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.753676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.754173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.755519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.757596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.761329 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a823-6aa9-4564-8af2-d87e5ec6f923 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.793856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 47/91] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:30:48 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:48.795313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.797237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.798172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.798513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.798842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.800225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.801861 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.804015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 45/92] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:48.809759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:48.919526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d5728-cb56-4486-87a9-1c6ecf94277c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.931705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81ae4c-cd18-4c0a-ae70-59dc54fa70c5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:48.973579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:48.974818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:48.975282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:48.975743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:48.978065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:48.979964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:48.982011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 48/93] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:48.988312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:49.004869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:49.005928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:49.006390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:49.006870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:49.117327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:49.119785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:49.140267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a74de5-ec0c-4c17-b221-c0b54e13568d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:49.183510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:49.184413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:49.184706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:49.184990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:49.186144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] RBAC: Adding query filter params (role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=a99077e3219448dd982cddd4372f35b3) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:49.186465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:49.187939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:49.200056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 49/94] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/role_assignments?user.id=a99077e3219448dd982cddd4372f35b3&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:49.233343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 46/95] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:30:49.239518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:49.350532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf3d81-d400-414a-858d-5d249d3d86f8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:49.387365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d806ea-7103-488c-ad6b-6386f4360aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:49.388666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d806ea-7103-488c-ad6b-6386f4360aeb None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:49.389148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d806ea-7103-488c-ad6b-6386f4360aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:49.389672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d806ea-7103-488c-ad6b-6386f4360aeb None admin] PATH_INFO: `/v3/projects/eadb70ea2813412b8efe724d531c9bec` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:49.391138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d806ea-7103-488c-ad6b-6386f4360aeb None admin] RBAC: Authorizing `identity:get_project(project_id=eadb70ea2813412b8efe724d531c9bec)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:49.392835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d806ea-7103-488c-ad6b-6386f4360aeb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:49.394926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 50/96] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:49 2022] GET /identity/v3/projects/eadb70ea2813412b8efe724d531c9bec => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:49.401582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:49.515718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eb712-d4ca-4ac2-b570-8a68668d9df3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:49.576736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea51d69-ed01-4631-9d21-adfaa944881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:49.577769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea51d69-ed01-4631-9d21-adfaa944881a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:49.578254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea51d69-ed01-4631-9d21-adfaa944881a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:49.578726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea51d69-ed01-4631-9d21-adfaa944881a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:49.579763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea51d69-ed01-4631-9d21-adfaa944881a None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=eadb70ea2813412b8efe724d531c9bec, user.id=a99077e3219448dd982cddd4372f35b3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:49.580549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea51d69-ed01-4631-9d21-adfaa944881a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:49.582270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea51d69-ed01-4631-9d21-adfaa944881a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:49.590357 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 47/97] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:49 2022] GET /identity/v3/role_assignments?user.id=a99077e3219448dd982cddd4372f35b3&scope.project.id=eadb70ea2813412b8efe724d531c9bec&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:50.833573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faffc6-50fa-4671-abfc-cb8b26cfae7b None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:50.834565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faffc6-50fa-4671-abfc-cb8b26cfae7b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:50.835050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faffc6-50fa-4671-abfc-cb8b26cfae7b None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:50.837296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 51/98] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:50.845332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2d66-e1b8-4c84-9b5b-43742300b58a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:50.846239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2d66-e1b8-4c84-9b5b-43742300b58a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:50.846721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2d66-e1b8-4c84-9b5b-43742300b58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:50.878771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2f9a2d66-e1b8-4c84-9b5b-43742300b58a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:50.880315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2f9a2d66-e1b8-4c84-9b5b-43742300b58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:50.965317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 48/99] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:51.003392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faffc6-50fa-4671-abfc-cb8b26cfae7b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:51.105653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faffc6-50fa-4671-abfc-cb8b26cfae7b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:51.139585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:51.140825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.141310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.141860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.154477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:51.162647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:51.163505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:51.164830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:51.167207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 52/100] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:30:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:51.173123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2d66-e1b8-4c84-9b5b-43742300b58a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:51.299271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2d66-e1b8-4c84-9b5b-43742300b58a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:51.345837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:51.346872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.347347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.347829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.348776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:51.349297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:51.350899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:51.364040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 49/101] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:51.370462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:51.474240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f286323-f250-4671-8fcc-0aba9e8d1334 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:51.509472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55149c2e-5ccb-459b-9ca8-1ea00cffa982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:51.510369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55149c2e-5ccb-459b-9ca8-1ea00cffa982 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.510651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55149c2e-5ccb-459b-9ca8-1ea00cffa982 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.510923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55149c2e-5ccb-459b-9ca8-1ea00cffa982 None admin] PATH_INFO: `/v3/users/9c5320af9c1c4a2f890e539109dfa042` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.512132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55149c2e-5ccb-459b-9ca8-1ea00cffa982 None admin] RBAC: Authorizing `identity:get_user(user_id=9c5320af9c1c4a2f890e539109dfa042)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:51.513599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55149c2e-5ccb-459b-9ca8-1ea00cffa982 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:51.515258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 53/102] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:51 2022] GET /identity/v3/users/9c5320af9c1c4a2f890e539109dfa042 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:51.520676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:51.600754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2c586-6a57-4a56-abac-f3bf6b2242b2 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.601452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2c586-6a57-4a56-abac-f3bf6b2242b2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.601978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2c586-6a57-4a56-abac-f3bf6b2242b2 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.603590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 54/103] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:30:51.609023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc83aa-3ae7-4285-a7a4-2284a538e5a9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.609581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc83aa-3ae7-4285-a7a4-2284a538e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.611414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc83aa-3ae7-4285-a7a4-2284a538e5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.628562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-48fc83aa-3ae7-4285-a7a4-2284a538e5a9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:51.630074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-48fc83aa-3ae7-4285-a7a4-2284a538e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:51.660859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafe3e-827d-4c25-8cd6-0f0487b54184 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:51.701160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 55/104] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:51.707541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:51.708589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.709023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.709443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.711389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:51.713024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:51.714903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 50/105] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:51 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:51.720406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc83aa-3ae7-4285-a7a4-2284a538e5a9 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:51.746964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:51.859179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc83aa-3ae7-4285-a7a4-2284a538e5a9 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:51.901276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:51.902452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.902879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.903138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb6c49-741b-4a0b-95f0-405da3cb1bde None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:51.903778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/9c5320af9c1c4a2f890e539109dfa042/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.906022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] RBAC: Authorizing `identity:create_grant(project_id=faae53d1802e4a62b3d4e52d7b2928c3, user_id=9c5320af9c1c4a2f890e539109dfa042, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:51.907608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:51.940247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 56/106] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:30:51 2022] PUT /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/9c5320af9c1c4a2f890e539109dfa042/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:30:51.967422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:51.968250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:51.968540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:51.968820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:51.990143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:52.002442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:52.003590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:52.004600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 51/107] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:30:52.011036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:52.160661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b2bc-8756-4c59-b1c6-52a406f24898 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:52.201283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399aa19-19a6-4746-97eb-b94e8ee37063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:52.202306 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399aa19-19a6-4746-97eb-b94e8ee37063 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.202772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399aa19-19a6-4746-97eb-b94e8ee37063 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.203227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399aa19-19a6-4746-97eb-b94e8ee37063 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.204419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399aa19-19a6-4746-97eb-b94e8ee37063 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:52.204905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399aa19-19a6-4746-97eb-b94e8ee37063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:52.206579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399aa19-19a6-4746-97eb-b94e8ee37063 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:52.217847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 57/108] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:52.222807 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:52.238605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1bce0-342f-43b9-9583-3b550e053a63 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.239158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1bce0-342f-43b9-9583-3b550e053a63 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.239644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1bce0-342f-43b9-9583-3b550e053a63 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.241199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 58/109] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:30:52.246280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6c58-8625-4dd1-ad12-d96b38eadadf None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.246767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6c58-8625-4dd1-ad12-d96b38eadadf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.247265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6c58-8625-4dd1-ad12-d96b38eadadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.264770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9eaf6c58-8625-4dd1-ad12-d96b38eadadf None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:52.268263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9eaf6c58-8625-4dd1-ad12-d96b38eadadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:52.355081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 59/110] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:52.389865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6c58-8625-4dd1-ad12-d96b38eadadf None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:52.447831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9ab7-d48a-4efb-8310-206b6c4bcefd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:52.539561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:52.540453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.540741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.541021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.543318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:52.544785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:52.548217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 52/111] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:52 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:52.555431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:52.612162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6c58-8625-4dd1-ad12-d96b38eadadf None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:52.695228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525fca5-8ed2-4dca-83b2-e969858cbb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:52.696052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525fca5-8ed2-4dca-83b2-e969858cbb24 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.696342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525fca5-8ed2-4dca-83b2-e969858cbb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.696621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525fca5-8ed2-4dca-83b2-e969858cbb24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.719585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525fca5-8ed2-4dca-83b2-e969858cbb24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b525fca5-8ed2-4dca-83b2-e969858cbb24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:52.730623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:52.731499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:52.732273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 60/112] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:30:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:52.733432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9e021-926f-4332-9d69-d4aa853865e1 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.733432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9e021-926f-4332-9d69-d4aa853865e1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.733656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9e021-926f-4332-9d69-d4aa853865e1 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.734939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 61/113] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:52.744257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9e021-926f-4332-9d69-d4aa853865e1 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:52.764665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d35d1-1f1c-4157-96c2-b2d524920d1c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:52.839626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325b598-4d5a-43e6-9692-77d11605ca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:52.840903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325b598-4d5a-43e6-9692-77d11605ca2a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.841439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325b598-4d5a-43e6-9692-77d11605ca2a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.841963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325b598-4d5a-43e6-9692-77d11605ca2a None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.845417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325b598-4d5a-43e6-9692-77d11605ca2a None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:52.847116 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325b598-4d5a-43e6-9692-77d11605ca2a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:52.851047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 53/114] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:52 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:52.853893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b25c64-9a33-4f39-a347-421c85d52eed None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.855683 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b25c64-9a33-4f39-a347-421c85d52eed None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.856877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b25c64-9a33-4f39-a347-421c85d52eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.890813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-04b25c64-9a33-4f39-a347-421c85d52eed None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:52.892057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-04b25c64-9a33-4f39-a347-421c85d52eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:52.917246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9e021-926f-4332-9d69-d4aa853865e1 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:52.961180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:52.962424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:52.963017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:52.963509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:52.964516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:52.965076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:52.966758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:52.976659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 62/115] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:30:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:52.978248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.028535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 54/116] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:53.029620 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b25c64-9a33-4f39-a347-421c85d52eed None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.127925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f13a5-32c6-48b1-8863-d8f8d9fbb7c1 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.161889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b25c64-9a33-4f39-a347-421c85d52eed None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.162108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.163301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.163922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.164130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/a99077e3219448dd982cddd4372f35b3/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.166170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] RBAC: Authorizing `identity:create_grant(project_id=faae53d1802e4a62b3d4e52d7b2928c3, user_id=a99077e3219448dd982cddd4372f35b3, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:53.167629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:53.183918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 63/117] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:30:52 2022] PUT /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/a99077e3219448dd982cddd4372f35b3/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:30:53.184749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.213001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004927d-8b59-4d43-af5e-73897dc5c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.214976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004927d-8b59-4d43-af5e-73897dc5c1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.215777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004927d-8b59-4d43-af5e-73897dc5c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.216277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004927d-8b59-4d43-af5e-73897dc5c1d9 None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.218799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004927d-8b59-4d43-af5e-73897dc5c1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:53.221381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004927d-8b59-4d43-af5e-73897dc5c1d9 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:53.224064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 55/118] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:53 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:53.226402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4933-e4d2-4ede-b258-f6a71715d4d4 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.226962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4933-e4d2-4ede-b258-f6a71715d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.227450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4933-e4d2-4ede-b258-f6a71715d4d4 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.229229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 56/119] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:53.234169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f134-9233-43ed-8f8d-069da0da2944 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.234705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f134-9233-43ed-8f8d-069da0da2944 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.235639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f134-9233-43ed-8f8d-069da0da2944 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.242213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 57/120] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:53.243153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f134-9233-43ed-8f8d-069da0da2944 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.326462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff74c-d9f3-4a78-b608-82075f4e5b1f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.370947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f134-9233-43ed-8f8d-069da0da2944 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.378440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ce7ef-b900-45b1-b8cb-fdf21e9bcd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.379580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ce7ef-b900-45b1-b8cb-fdf21e9bcd4b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.380102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ce7ef-b900-45b1-b8cb-fdf21e9bcd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.380994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ce7ef-b900-45b1-b8cb-fdf21e9bcd4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.396831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ce7ef-b900-45b1-b8cb-fdf21e9bcd4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b63ce7ef-b900-45b1-b8cb-fdf21e9bcd4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:53.405486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:53.406554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:53.407541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:53.409576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 64/121] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:53.410952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf312999-bb49-4087-afe8-cfade121a1c7 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.411399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf312999-bb49-4087-afe8-cfade121a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.411826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf312999-bb49-4087-afe8-cfade121a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.412453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f8895-3e05-4f12-a7c7-f2484bb00de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.413982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8895-3e05-4f12-a7c7-f2484bb00de0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.414365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8895-3e05-4f12-a7c7-f2484bb00de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.414740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f8895-3e05-4f12-a7c7-f2484bb00de0 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.416552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f8895-3e05-4f12-a7c7-f2484bb00de0 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:53.418258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f8895-3e05-4f12-a7c7-f2484bb00de0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:53.420300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 58/122] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:53 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:53.423668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e0ec-5882-418b-acee-f67d5a677605 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.423668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e0ec-5882-418b-acee-f67d5a677605 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.423668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e0ec-5882-418b-acee-f67d5a677605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.436866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bf312999-bb49-4087-afe8-cfade121a1c7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:53.438497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bf312999-bb49-4087-afe8-cfade121a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:53.441145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3eb0e0ec-5882-418b-acee-f67d5a677605 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:53.443350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3eb0e0ec-5882-418b-acee-f67d5a677605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:53.516534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 65/123] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:53.517516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf312999-bb49-4087-afe8-cfade121a1c7 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.529916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 59/124] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:53.531009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e0ec-5882-418b-acee-f67d5a677605 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.635455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf312999-bb49-4087-afe8-cfade121a1c7 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.653712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e0ec-5882-418b-acee-f67d5a677605 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.676213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.677128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.677569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.678004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.679445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:53.679884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:53.681404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:53.689932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 66/125] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:53.690962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.691634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.692533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.692821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.693100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/a99077e3219448dd982cddd4372f35b3/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.696422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=faae53d1802e4a62b3d4e52d7b2928c3, user_id=a99077e3219448dd982cddd4372f35b3, role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:53.697855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:53.712587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 60/126] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:30:53 2022] PUT /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/a99077e3219448dd982cddd4372f35b3/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:30:53.717729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.825006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d897d55-9998-4b45-be16-5b98821713c5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.862902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.863724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.864012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.864356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.864778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9830-fe90-4724-9407-16fe2b1654c0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:53.865665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:53.867807 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:53.869642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 61/127] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:53.870500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.936383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:53.937196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:53.937482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:53.937782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:53.959495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:53.976721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:53.977656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:53.978455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 67/128] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:53.979105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:53.985849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3e4f-7999-4dce-b95f-85ae003f6e52 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:54.024709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:54.026023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.026503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.026969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.029207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:54.031399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:54.033287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 62/129] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:53 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:54.034327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:54.095328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b9b6-d68b-4622-9cf0-b7d14088e20e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:54.131332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:54.132536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.132823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.133280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.134040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:54.135557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:54.168199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 68/130] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:30:53 2022] POST /identity/v3/projects => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:54.169062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:54.284388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c2da-a068-4d10-8ff8-3b1aa8bec98d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:54.324731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:54.325765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.326057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.326338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] PATH_INFO: `/v3/projects/eadb70ea2813412b8efe724d531c9bec` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.327696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=eadb70ea2813412b8efe724d531c9bec)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:54.329426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:54.330103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1079c0-6805-4ab4-bff8-027e534f3745 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:54.331498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 69/131] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:54 2022] GET /identity/v3/projects/eadb70ea2813412b8efe724d531c9bec => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:54.345732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:54.406470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:54.407166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.407456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.407735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.408508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:54.408821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:54.410289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:54.429531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 63/132] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:54.455102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:54.468307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e59d8-5ff7-44e1-aaed-73497bee1bd2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:54.522924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:54.524177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.524657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.525097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] PATH_INFO: `/v3/projects/eadb70ea2813412b8efe724d531c9bec/users/a99077e3219448dd982cddd4372f35b3/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.527699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] RBAC: Authorizing `identity:create_grant(project_id=eadb70ea2813412b8efe724d531c9bec, user_id=a99077e3219448dd982cddd4372f35b3, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:54.529463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:54.558256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 70/133] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:30:54 2022] PUT /identity/v3/projects/eadb70ea2813412b8efe724d531c9bec/users/a99077e3219448dd982cddd4372f35b3/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:30:54.630087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d4a5-e52a-43f8-b398-3ae6d74db486 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:54.665504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c36ad-59dc-4b7a-a22b-1b777e36019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:54.667279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c36ad-59dc-4b7a-a22b-1b777e36019d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.667926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c36ad-59dc-4b7a-a22b-1b777e36019d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.668686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c36ad-59dc-4b7a-a22b-1b777e36019d None admin] PATH_INFO: `/v3/users/6d54c07bfdae47989b0d1bac1300f20a` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.688504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c36ad-59dc-4b7a-a22b-1b777e36019d None admin] RBAC: Authorizing `identity:get_user(user_id=6d54c07bfdae47989b0d1bac1300f20a)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:54.690900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c36ad-59dc-4b7a-a22b-1b777e36019d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:54.692872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 64/134] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:54 2022] GET /identity/v3/users/6d54c07bfdae47989b0d1bac1300f20a => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:54.700266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:54.701221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e338-a2b1-4109-b647-844976506b19 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.701735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e338-a2b1-4109-b647-844976506b19 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.702235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e338-a2b1-4109-b647-844976506b19 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.705323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 65/135] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:54.711554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ca562-6bf1-4e46-a37d-e4c93318dea6 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.712173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ca562-6bf1-4e46-a37d-e4c93318dea6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.712668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ca562-6bf1-4e46-a37d-e4c93318dea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:54.745928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d15ca562-6bf1-4e46-a37d-e4c93318dea6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:54.747175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d15ca562-6bf1-4e46-a37d-e4c93318dea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:54.886879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 66/136] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 12 11:30:54.895619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391253-208d-4386-b0b8-80642ed8a70d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:54.930485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:54.931136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:54.931419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:54.931694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:55.010291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ca562-6bf1-4e46-a37d-e4c93318dea6 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:55.026224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:55.027694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:55.125150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ca562-6bf1-4e46-a37d-e4c93318dea6 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:55.154770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 71/137] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:30:55.158986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:55.159836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:55.160121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:55.160392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:55.161120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:55.178089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:55.179007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:55.179890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:55.180669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 67/138] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:30:55.216465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:55.279031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0274c-15b1-434a-8ed7-8f8d11b85426 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:55.321169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:55.322435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:55.322931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:55.323410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:55.324939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:55.327961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:55.333915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 72/139] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:55 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:55.338048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:55.429859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d5f9-c4bc-46a5-af67-d1d592392d10 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:55.478127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:55.479038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:55.479038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:55.479332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:55.480101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:55.480384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:55.482650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea2d22-1a84-4346-b382-4d6a1b2dedf0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:55.489861 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:55.498774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 68/140] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:55.507339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:55.529105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:55.530062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:55.531835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:55.532258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:55.533252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] RBAC: Adding query filter params (role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=6d54c07bfdae47989b0d1bac1300f20a) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:55.534492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:55.536827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:55.547807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 73/141] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:55 2022] GET /identity/v3/role_assignments?user.id=6d54c07bfdae47989b0d1bac1300f20a&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:55.660356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b11a5e-a51b-4121-8b33-ced9de5ca8b5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:55.704178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:55.705294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:55.705738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:55.706170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] PATH_INFO: `/v3/users/9c5320af9c1c4a2f890e539109dfa042` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:55.707513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] RBAC: Authorizing `identity:get_user(user_id=9c5320af9c1c4a2f890e539109dfa042)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:55.709106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:55.710959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 69/142] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:55 2022] GET /identity/v3/users/9c5320af9c1c4a2f890e539109dfa042 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:55.716764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:55.846627 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ae68-f2b5-452a-8aad-14f5ff10bf99 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:55.893268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:55.893972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:55.894260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:55.894540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:55.992191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:55.993677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:56.112203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 74/143] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:30:56.117962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:56.264649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe2763-92d4-4e8e-986f-441305450056 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:56.305663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a2d90-bada-4df0-8555-3be496e101ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:56.306914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a2d90-bada-4df0-8555-3be496e101ac None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:56.307418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a2d90-bada-4df0-8555-3be496e101ac None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:56.307908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a2d90-bada-4df0-8555-3be496e101ac None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:56.309307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a2d90-bada-4df0-8555-3be496e101ac None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:56.310984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a2d90-bada-4df0-8555-3be496e101ac None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:56.312929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 70/144] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:56 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:56.319405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:56.473383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f30524-b370-4aeb-aad6-889b1bb25ce4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:56.522534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a84d1-2b7e-46db-9207-7a23133ea503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:56.523135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a84d1-2b7e-46db-9207-7a23133ea503 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:56.523422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a84d1-2b7e-46db-9207-7a23133ea503 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:56.523702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a84d1-2b7e-46db-9207-7a23133ea503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:56.524542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a84d1-2b7e-46db-9207-7a23133ea503 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=9c5320af9c1c4a2f890e539109dfa042) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:56.524854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a84d1-2b7e-46db-9207-7a23133ea503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:56.526322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a84d1-2b7e-46db-9207-7a23133ea503 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:56.539092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 75/145] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:56 2022] GET /identity/v3/role_assignments?user.id=9c5320af9c1c4a2f890e539109dfa042&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:56.565865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8c2e-75d3-43ae-a9f9-deaaa0931e10 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:56.566179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8c2e-75d3-43ae-a9f9-deaaa0931e10 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:56.566445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8c2e-75d3-43ae-a9f9-deaaa0931e10 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:56.567852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 71/146] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:56.577234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdfced-572e-403c-9ed5-c8a699b50a08 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:56.577613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdfced-572e-403c-9ed5-c8a699b50a08 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:56.577814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdfced-572e-403c-9ed5-c8a699b50a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:56.606276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-12bdfced-572e-403c-9ed5-c8a699b50a08 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:56.607511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-12bdfced-572e-403c-9ed5-c8a699b50a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:56.696129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 76/147] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:56.729436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee8c2e-75d3-43ae-a9f9-deaaa0931e10 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:56.852264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee8c2e-75d3-43ae-a9f9-deaaa0931e10 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:56.902880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ed12c-168b-4b6c-a637-21b7e9a2ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:56.903690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed12c-168b-4b6c-a637-21b7e9a2ba1c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:56.903976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed12c-168b-4b6c-a637-21b7e9a2ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:56.904255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed12c-168b-4b6c-a637-21b7e9a2ba1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:56.916897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ed12c-168b-4b6c-a637-21b7e9a2ba1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-5d1ed12c-168b-4b6c-a637-21b7e9a2ba1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:56.924899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:56.925789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:56.926579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 72/148] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:56.932817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdfced-572e-403c-9ed5-c8a699b50a08 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:57.026989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5705-6ec2-4458-bd7c-6cf73f4328ae None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.026989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5705-6ec2-4458-bd7c-6cf73f4328ae None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.026989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5705-6ec2-4458-bd7c-6cf73f4328ae None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.026989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 73/149] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:30:57.032594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68ff78-ed93-4826-b893-de613e002e5c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.033147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68ff78-ed93-4826-b893-de613e002e5c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.033529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68ff78-ed93-4826-b893-de613e002e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.035325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdfced-572e-403c-9ed5-c8a699b50a08 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:57.063546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-dd68ff78-ed93-4826-b893-de613e002e5c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:57.066064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-dd68ff78-ed93-4826-b893-de613e002e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:57.090310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:57.091255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.091683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.092117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.093046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:57.093557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:57.095100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:57.110559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 77/150] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:57.118038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:57.192921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 74/151] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:30:57.238500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68ff78-ed93-4826-b893-de613e002e5c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:57.277632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590f5a0-2a2f-4212-9a60-ab705d9f94d4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:57.340811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:57.341997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.342424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.342864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.345546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:57.347183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:57.351566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 78/152] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:57 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:57.358211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:57.408565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68ff78-ed93-4826-b893-de613e002e5c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:57.476521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:57.477572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.478020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.478462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.505928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:57.514506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:57.515651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:30:57.516596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:30:57.522600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 75/153] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:30:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:30:57.528673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:57.544874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82f1a8-8f39-4c1d-b1c1-a5a7a3f57b92 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:57.582015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a68cd-0a72-42c5-9397-2a06527be40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:57.582905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a68cd-0a72-42c5-9397-2a06527be40e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.583334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a68cd-0a72-42c5-9397-2a06527be40e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.584311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a68cd-0a72-42c5-9397-2a06527be40e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.709300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a68cd-0a72-42c5-9397-2a06527be40e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:57.710892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a68cd-0a72-42c5-9397-2a06527be40e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:57.721452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa770b66-56bf-4984-9d93-d02cce31ba84 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:57.756108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb711da-e60e-47b8-9bfa-70b1de814727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:57.756913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb711da-e60e-47b8-9bfa-70b1de814727 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.757376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb711da-e60e-47b8-9bfa-70b1de814727 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.757863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb711da-e60e-47b8-9bfa-70b1de814727 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.758755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb711da-e60e-47b8-9bfa-70b1de814727 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:57.759209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb711da-e60e-47b8-9bfa-70b1de814727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:57.760767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb711da-e60e-47b8-9bfa-70b1de814727 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:57.769394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 76/154] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:30:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:57.770967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699bd0-d167-47db-bbc4-4cdb33d3963d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.771426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699bd0-d167-47db-bbc4-4cdb33d3963d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.771849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699bd0-d167-47db-bbc4-4cdb33d3963d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.773338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 77/155] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:57.778138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699bd0-d167-47db-bbc4-4cdb33d3963d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:57.829431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 79/156] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:30:57.830971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32467-5067-436d-8f35-37c1dffb2c76 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.831258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32467-5067-436d-8f35-37c1dffb2c76 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.831535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32467-5067-436d-8f35-37c1dffb2c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.851831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-2ff32467-5067-436d-8f35-37c1dffb2c76 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:57.854183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2ff32467-5067-436d-8f35-37c1dffb2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:57.886070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699bd0-d167-47db-bbc4-4cdb33d3963d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:57.921581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeafad-04f7-4077-8916-deea2b9c5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:57.922635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeafad-04f7-4077-8916-deea2b9c5721 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.923213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeafad-04f7-4077-8916-deea2b9c5721 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.923495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeafad-04f7-4077-8916-deea2b9c5721 None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.924840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeafad-04f7-4077-8916-deea2b9c5721 None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:57.926334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeafad-04f7-4077-8916-deea2b9c5721 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:57.933928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 80/157] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:57.934061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 78/158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:57 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:57.934135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff32467-5067-436d-8f35-37c1dffb2c76 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:57.934201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94421fec-1266-4d07-981d-b68d345991b0 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:57.934201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94421fec-1266-4d07-981d-b68d345991b0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:57.934201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94421fec-1266-4d07-981d-b68d345991b0 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:57.934201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 79/159] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:57.934201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94421fec-1266-4d07-981d-b68d345991b0 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.039926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff32467-5067-436d-8f35-37c1dffb2c76 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.040986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94421fec-1266-4d07-981d-b68d345991b0 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.073817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d9ebf-b984-4e6d-b335-13175f442953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.074657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9ebf-b984-4e6d-b335-13175f442953 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.074919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.075038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9ebf-b984-4e6d-b335-13175f442953 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.075253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9ebf-b984-4e6d-b335-13175f442953 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.075557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.075839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.076106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.076461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d9ebf-b984-4e6d-b335-13175f442953 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.078230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d9ebf-b984-4e6d-b335-13175f442953 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.079919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 81/160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:57 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:58.081047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03faa11-6063-4ce5-873d-4f56c2343b27 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.081326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03faa11-6063-4ce5-873d-4f56c2343b27 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.081597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03faa11-6063-4ce5-873d-4f56c2343b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.097688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d03faa11-6063-4ce5-873d-4f56c2343b27 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:58.098857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d03faa11-6063-4ce5-873d-4f56c2343b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:58.147644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.149527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.165261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 82/161] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:58.166165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03faa11-6063-4ce5-873d-4f56c2343b27 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.269209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 80/162] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:30:58.274667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.278795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03faa11-6063-4ce5-873d-4f56c2343b27 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.315430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.316505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.317087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.317380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.330724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:58.339420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:58.340412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 83/163] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:30:58.341193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.375958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5255-44ac-4888-a652-e011041e9d72 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.408428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.409078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.409629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.409629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.410453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=a99077e3219448dd982cddd4372f35b3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:58.410759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.412801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.425855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 81/164] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/role_assignments?user.id=a99077e3219448dd982cddd4372f35b3&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:58.425855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.453010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0259be-a5f9-4d03-a073-0e99cc24ac40 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.490177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.491023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.491305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.491579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.492965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.494536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.496536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 84/165] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:58.502193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.572824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63629403-25cb-40fa-8b28-f4ce59069c11 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.614112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.615583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.615863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.616136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.617597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.619104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.621013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 82/166] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:58.621875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.632504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e791404-ec5b-4a0f-93e1-2ae119981317 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.680927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.681600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.681990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.682270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.683024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:58.683337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.684712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.697612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 85/167] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:58.699369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.748256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b8ed-a976-494f-80a5-01ad86354430 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.779960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b285e2-95fd-47f2-8a10-14ad7dcb11e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.780630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b285e2-95fd-47f2-8a10-14ad7dcb11e0 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.780914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b285e2-95fd-47f2-8a10-14ad7dcb11e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.781189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b285e2-95fd-47f2-8a10-14ad7dcb11e0 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.781941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b285e2-95fd-47f2-8a10-14ad7dcb11e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.783406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b285e2-95fd-47f2-8a10-14ad7dcb11e0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.799000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1deaa-609f-483a-a315-3c3062f27318 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.804133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 83/168] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:30:58 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:30:58.804133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d409-2e4b-4fba-a496-cb1a2dcc476e None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.804133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d409-2e4b-4fba-a496-cb1a2dcc476e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.804133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d409-2e4b-4fba-a496-cb1a2dcc476e None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.804133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 84/169] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:30:58.804133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930d409-2e4b-4fba-a496-cb1a2dcc476e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:58.839908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262c47a-3315-48a8-ba09-3ba27e8e0c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:58.840484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262c47a-3315-48a8-ba09-3ba27e8e0c91 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.840761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262c47a-3315-48a8-ba09-3ba27e8e0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.841031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262c47a-3315-48a8-ba09-3ba27e8e0c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.841925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262c47a-3315-48a8-ba09-3ba27e8e0c91 None admin] RBAC: Adding query filter params (role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=a99077e3219448dd982cddd4372f35b3) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:58.842233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262c47a-3315-48a8-ba09-3ba27e8e0c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:58.843724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262c47a-3315-48a8-ba09-3ba27e8e0c91 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:58.850492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 86/170] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/role_assignments?user.id=a99077e3219448dd982cddd4372f35b3&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:58.851586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8c02d-ac72-4fbb-a3c2-480d3b5c8b52 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:58.851870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8c02d-ac72-4fbb-a3c2-480d3b5c8b52 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:58.852143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8c02d-ac72-4fbb-a3c2-480d3b5c8b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:58.878589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-3fb8c02d-ac72-4fbb-a3c2-480d3b5c8b52 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:30:58.879838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-3fb8c02d-ac72-4fbb-a3c2-480d3b5c8b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:30:58.958020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930d409-2e4b-4fba-a496-cb1a2dcc476e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:58.969736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 87/171] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:30:58.990896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8c02d-ac72-4fbb-a3c2-480d3b5c8b52 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.013762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.015574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.015850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.016121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] PATH_INFO: `/v3/users/a99077e3219448dd982cddd4372f35b3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.017444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] RBAC: Authorizing `identity:get_user(user_id=a99077e3219448dd982cddd4372f35b3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.019013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.020708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 85/172] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/users/a99077e3219448dd982cddd4372f35b3 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:59.026724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.106121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8c02d-ac72-4fbb-a3c2-480d3b5c8b52 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.142097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.143868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.143868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.143868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.152528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a3a6-2232-4370-994e-40ad08a88d5d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.155589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:30:59.164092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:30:59.165913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:30:59.166713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 88/173] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:30:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:30:59.173423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.194136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.194820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.195079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.195359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.269472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.271920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.279002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8882-f06e-429e-9ff6-3673b0f0c04e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.312949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.313656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.313938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.314217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.314975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:59.315284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.316746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.329844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 89/174] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:30:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:59.332055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.392417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 86/175] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:30:59.398174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.446550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9e8ed-bd3c-4dfc-9e2a-f6c6636b7028 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.500529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.502050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.502473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.502754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] PATH_INFO: `/v3/users/6d54c07bfdae47989b0d1bac1300f20a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.504701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] RBAC: Authorizing `identity:get_user(user_id=6d54c07bfdae47989b0d1bac1300f20a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.506120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.512924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 90/176] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:30:59 2022] GET /identity/v3/users/6d54c07bfdae47989b0d1bac1300f20a => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:59.513893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.515737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a049ca-d123-4593-8e6b-47e5deec95f4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.556562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.557432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.557735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.558014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] PATH_INFO: `/v3/projects/eadb70ea2813412b8efe724d531c9bec` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.563230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] RBAC: Authorizing `identity:get_project(project_id=eadb70ea2813412b8efe724d531c9bec)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.563230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.563230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 87/177] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:59 2022] GET /identity/v3/projects/eadb70ea2813412b8efe724d531c9bec => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:59.569935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.632341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4661-d793-4e1b-b268-35c7bcb43daa None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.670266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.671637 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.671967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.672416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.673638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.675100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.678217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 91/178] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:30:59 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:30:59.686920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:30:59.773021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74261a9a-f057-48d0-86ad-de47020377e5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.845249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceceb72-adfc-41bf-8376-9e1b972cd694 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:30:59.847992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be93a22-401c-47fd-9bc4-bf11f11bd091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.848688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93a22-401c-47fd-9bc4-bf11f11bd091 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.849019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93a22-401c-47fd-9bc4-bf11f11bd091 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.849297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93a22-401c-47fd-9bc4-bf11f11bd091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.850220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be93a22-401c-47fd-9bc4-bf11f11bd091 None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=eadb70ea2813412b8efe724d531c9bec, user.id=a99077e3219448dd982cddd4372f35b3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:30:59.850531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be93a22-401c-47fd-9bc4-bf11f11bd091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.851995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be93a22-401c-47fd-9bc4-bf11f11bd091 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.867901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 88/179] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:30:59 2022] GET /identity/v3/role_assignments?user.id=a99077e3219448dd982cddd4372f35b3&scope.project.id=eadb70ea2813412b8efe724d531c9bec&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:30:59.900800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28e605-4df8-4524-b27f-a799e87df1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:30:59.901739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28e605-4df8-4524-b27f-a799e87df1bb None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:30:59.902032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28e605-4df8-4524-b27f-a799e87df1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:30:59.902311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28e605-4df8-4524-b27f-a799e87df1bb None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/6d54c07bfdae47989b0d1bac1300f20a/roles/7a8626fbf5cd4b0aadd9a8a49fc6c3f6` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:30:59.907223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28e605-4df8-4524-b27f-a799e87df1bb None admin] RBAC: Authorizing `identity:create_grant(project_id=faae53d1802e4a62b3d4e52d7b2928c3, user_id=6d54c07bfdae47989b0d1bac1300f20a, role_id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:30:59.908735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28e605-4df8-4524-b27f-a799e87df1bb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:30:59.935220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 92/180] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:30:59 2022] PUT /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/users/6d54c07bfdae47989b0d1bac1300f20a/roles/7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:01.359306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a3ac-5ed5-4bf3-9155-ef3446773f91 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.359850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a3ac-5ed5-4bf3-9155-ef3446773f91 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.359850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a3ac-5ed5-4bf3-9155-ef3446773f91 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.361371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 89/181] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:01.367293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806556-505a-41eb-b06a-90067bb4a760 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.367685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806556-505a-41eb-b06a-90067bb4a760 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.367863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806556-505a-41eb-b06a-90067bb4a760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.385608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b5806556-505a-41eb-b06a-90067bb4a760 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:01.386835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b5806556-505a-41eb-b06a-90067bb4a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:01.459333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 93/182] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:01.482642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a3ac-5ed5-4bf3-9155-ef3446773f91 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:01.592293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a3ac-5ed5-4bf3-9155-ef3446773f91 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:01.627896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c63634-d6be-4c74-9054-5cf87622e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:01.628607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c63634-d6be-4c74-9054-5cf87622e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.628884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c63634-d6be-4c74-9054-5cf87622e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.629154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c63634-d6be-4c74-9054-5cf87622e3d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.639559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c63634-d6be-4c74-9054-5cf87622e3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b5c63634-d6be-4c74-9054-5cf87622e3d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:01.647336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:01.648211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:01.648998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 90/183] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:01.655921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806556-505a-41eb-b06a-90067bb4a760 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:01.678930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2643a-81c9-4e90-ba9b-8afe51f6d83a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.679232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2643a-81c9-4e90-ba9b-8afe51f6d83a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.679487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2643a-81c9-4e90-ba9b-8afe51f6d83a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.680853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 91/184] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:01.685800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d940-8c01-42fc-b2b1-7ea6ad38c395 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.686088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d940-8c01-42fc-b2b1-7ea6ad38c395 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.686369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d940-8c01-42fc-b2b1-7ea6ad38c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.704968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c5f3d940-8c01-42fc-b2b1-7ea6ad38c395 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:01.706196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c5f3d940-8c01-42fc-b2b1-7ea6ad38c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:01.756903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806556-505a-41eb-b06a-90067bb4a760 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:01.771935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 92/185] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:01.777848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1023d-33b8-4753-b8d8-73fc6fdf1179 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.777848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1023d-33b8-4753-b8d8-73fc6fdf1179 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.777848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1023d-33b8-4753-b8d8-73fc6fdf1179 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.777848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 93/186] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:01.783356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8aa70-73f2-4f67-ba7d-f54a58b85d3e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.783650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8aa70-73f2-4f67-ba7d-f54a58b85d3e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.783933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8aa70-73f2-4f67-ba7d-f54a58b85d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.793069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:01.793761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.794045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.794318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.795067 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:01.795372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:01.796915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:01.801090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8fc8aa70-73f2-4f67-ba7d-f54a58b85d3e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:01.802891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8fc8aa70-73f2-4f67-ba7d-f54a58b85d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:01.806022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 94/187] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:01.810633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:01.873956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 94/188] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:01.874876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8aa70-73f2-4f67-ba7d-f54a58b85d3e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:01.916341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c1d9-4e3f-4dd0-9ec3-cc838d3865a5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:01.949260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:01.950074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:01.950356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:01.950625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:01.952044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:01.953463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:01.955269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 95/189] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:01.958588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:01.982014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8aa70-73f2-4f67-ba7d-f54a58b85d3e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.015491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.016684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.017166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.017639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] PATH_INFO: `/v3/users/b08036a5cc14479ba3cd98deb664daca` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.031295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] RBAC: Authorizing `identity:get_user(user_id=b08036a5cc14479ba3cd98deb664daca)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:02.033056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:02.034873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 95/190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:01 2022] GET /identity/v3/users/b08036a5cc14479ba3cd98deb664daca => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:02.034873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.060065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c3dad-046f-4293-99dc-c7f895020437 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.094843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.095642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.095920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.096193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.106087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:02.114529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:02.115418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:02.116237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 96/191] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:02.116887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.145208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8151dae-e274-4c78-b0b2-c10de1aa6b49 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.180264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.180852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.181136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.181413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.182169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:02.183613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:02.205146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 96/192] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:02 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:02.206418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.244117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa198-aa01-4634-bd6b-ad5a8327403a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.299312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04cfb-4cc8-4150-807d-7eb2fe2c1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.300374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04cfb-4cc8-4150-807d-7eb2fe2c1e9e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.300836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04cfb-4cc8-4150-807d-7eb2fe2c1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.301964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04cfb-4cc8-4150-807d-7eb2fe2c1e9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.315436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01148-8d1c-4971-8da2-9ab4e5611a3b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.354384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc1395-d3aa-4fc5-a1f1-010caee35f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.355079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1395-d3aa-4fc5-a1f1-010caee35f7f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.355698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1395-d3aa-4fc5-a1f1-010caee35f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.356035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1395-d3aa-4fc5-a1f1-010caee35f7f None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.357129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc1395-d3aa-4fc5-a1f1-010caee35f7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:02.357437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc1395-d3aa-4fc5-a1f1-010caee35f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:02.359602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc1395-d3aa-4fc5-a1f1-010caee35f7f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:02.370589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 97/193] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:02.371777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dca915-74b9-4e0f-9f76-a95940502d3e None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.372122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dca915-74b9-4e0f-9f76-a95940502d3e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.372404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dca915-74b9-4e0f-9f76-a95940502d3e None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.373827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 98/194] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:02.378403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dca915-74b9-4e0f-9f76-a95940502d3e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.388018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04cfb-4cc8-4150-807d-7eb2fe2c1e9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:02.389509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04cfb-4cc8-4150-807d-7eb2fe2c1e9e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:02.483823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dca915-74b9-4e0f-9f76-a95940502d3e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.507805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 97/195] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:02.509168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45491-6015-4318-9bfa-747e8b6f780f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.509459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45491-6015-4318-9bfa-747e8b6f780f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.509760 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45491-6015-4318-9bfa-747e8b6f780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.519614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.520522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.520805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.521079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] PATH_INFO: `/v3/users/b08036a5cc14479ba3cd98deb664daca` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.522323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] RBAC: Authorizing `identity:get_user(user_id=b08036a5cc14479ba3cd98deb664daca)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:02.523796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:02.525444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 99/196] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/users/b08036a5cc14479ba3cd98deb664daca => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:02.526570 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6fe45491-6015-4318-9bfa-747e8b6f780f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:02.527866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6fe45491-6015-4318-9bfa-747e8b6f780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:02.528302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.607784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 98/197] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:02.608644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45491-6015-4318-9bfa-747e8b6f780f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.673006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c35b8-e325-452c-889e-c5d334beed51 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.706576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.707963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.708243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.708530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.709724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:02.711170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:02.712904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 100/198] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:02.713727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.736942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45491-6015-4318-9bfa-747e8b6f780f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.771159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.772219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.772219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.772508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.827279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242d65-56f8-4eab-a43e-e49237da1dec None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:02.843180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:02.844776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:02.863598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:02.864763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:02.865243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:02.865738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:02.876587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:02.886560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:02.887485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:02.888278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:02.890695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 101/199] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:02.891695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.950705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 99/200] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:02.951636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:02.997837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441cf1b-eb2f-47d0-b6f5-f37e22b83a8e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:03.035610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:03.036263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:03.036546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:03.036822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:03.037661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=b08036a5cc14479ba3cd98deb664daca) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:03.039109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:03.040175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:03.046093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 102/201] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/role_assignments?user.id=b08036a5cc14479ba3cd98deb664daca&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:03.046943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:03.073199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a90c1-453d-4789-b8ac-acf3f53b48ac None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:03.111391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:03.112406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:03.112926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:03.113488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:03.114987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:03.115503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:03.117120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:03.126511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 100/202] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:03.133817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:03.165883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d4995-dd1c-443d-9d05-fe56ba1ad8b9 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:03.198239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:03.199097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:03.199375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:03.199649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:03.200850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:03.210339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:03.210339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 103/203] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:03 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:03.214797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:03.311803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ac9e-1b08-4964-851f-2103015ff04e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:03.373138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:03.374144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:03.374433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:03.374710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] PATH_INFO: `/v3/users/6d54c07bfdae47989b0d1bac1300f20a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:03.375927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] RBAC: Authorizing `identity:get_user(user_id=6d54c07bfdae47989b0d1bac1300f20a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:03.377459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:03.379944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 101/204] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:03 2022] GET /identity/v3/users/6d54c07bfdae47989b0d1bac1300f20a => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:03.381579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1fcd-8675-418f-8d51-17036e9f0e43 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:03.395995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:03.423996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:03.424649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:03.424927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:03.425199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:03.426589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] RBAC: Adding query filter params (role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=b08036a5cc14479ba3cd98deb664daca) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:03.426900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:03.428360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:03.439520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 104/205] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:03 2022] GET /identity/v3/role_assignments?user.id=b08036a5cc14479ba3cd98deb664daca&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:03.563941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e042475-fba0-4a73-9e6c-7e3a47518dfa None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:03.607473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:03.608140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:03.608422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:03.608697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:03.710431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:03.711960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:03.817909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 102/206] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:31:03.823565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:03.968886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e0dbb-8eff-45e5-ab3c-2ba3a4d457c0 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:04.009136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3a22a-2038-404d-9fe9-2a70894a83ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:04.010403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a22a-2038-404d-9fe9-2a70894a83ce None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:04.010890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a22a-2038-404d-9fe9-2a70894a83ce None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:04.011360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a22a-2038-404d-9fe9-2a70894a83ce None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:04.012767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3a22a-2038-404d-9fe9-2a70894a83ce None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:04.014448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3a22a-2038-404d-9fe9-2a70894a83ce None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:04.016337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 105/207] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:03 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:04.022869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:04.157029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd691-a901-4dbb-a79f-b48b0dc578a2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:04.195556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d82da7-f921-46ff-a7f4-e393167b16c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:04.196273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82da7-f921-46ff-a7f4-e393167b16c6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:04.196561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82da7-f921-46ff-a7f4-e393167b16c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:04.196837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d82da7-f921-46ff-a7f4-e393167b16c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:04.197682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82da7-f921-46ff-a7f4-e393167b16c6 None admin] RBAC: Adding query filter params (role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3, user.id=6d54c07bfdae47989b0d1bac1300f20a) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:04.198015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82da7-f921-46ff-a7f4-e393167b16c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:04.199457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d82da7-f921-46ff-a7f4-e393167b16c6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:04.209846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 103/208] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:04 2022] GET /identity/v3/role_assignments?user.id=6d54c07bfdae47989b0d1bac1300f20a&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:04.862547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35aac0-ea24-47c3-8f35-80999bd839e0 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:04.863574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35aac0-ea24-47c3-8f35-80999bd839e0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:04.863574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35aac0-ea24-47c3-8f35-80999bd839e0 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:04.864949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 106/209] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:04.870487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4131ab0-199a-4f59-8362-9308dc1328eb None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:04.870906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4131ab0-199a-4f59-8362-9308dc1328eb None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:04.871042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4131ab0-199a-4f59-8362-9308dc1328eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:04.893764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d4131ab0-199a-4f59-8362-9308dc1328eb None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:04.894917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d4131ab0-199a-4f59-8362-9308dc1328eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:04.896205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91070419-8ee1-42e2-8ba5-b538ef407adb None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:04.896700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91070419-8ee1-42e2-8ba5-b538ef407adb None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:04.897302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91070419-8ee1-42e2-8ba5-b538ef407adb None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:04.898956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 107/210] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:04.905396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f74cf-2783-48f7-8e7b-974890da467a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:04.905935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f74cf-2783-48f7-8e7b-974890da467a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:04.906731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f74cf-2783-48f7-8e7b-974890da467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:04.935583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5d0f74cf-2783-48f7-8e7b-974890da467a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:04.937209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5d0f74cf-2783-48f7-8e7b-974890da467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:04.984231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 104/211] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:05.002731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4131ab0-199a-4f59-8362-9308dc1328eb None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.010699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 108/212] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:05.034371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f74cf-2783-48f7-8e7b-974890da467a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.114963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4131ab0-199a-4f59-8362-9308dc1328eb None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:05.149485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f74cf-2783-48f7-8e7b-974890da467a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:05.150970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:05.151982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.152481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.152948 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.154562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:05.156211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:05.158207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 105/213] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:05.163816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.185731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:05.186796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.187220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.187637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.202137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:05.212540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:05.213637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:05.214650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:05.217113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 109/214] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:05.231349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.280082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42bae1-0997-4a8e-9875-a14742b9234e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:05.324271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:05.325371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.326084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.326813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.327975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:05.330295 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:05.332407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae2ca2-565c-4a27-b102-0f6d31dfa458 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:05.356082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 106/215] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:05 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:05.374371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f547b-e56b-4f21-ad35-37ddf9a31525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:05.375496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f547b-e56b-4f21-ad35-37ddf9a31525 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.376054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f547b-e56b-4f21-ad35-37ddf9a31525 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.376573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f547b-e56b-4f21-ad35-37ddf9a31525 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.377685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f547b-e56b-4f21-ad35-37ddf9a31525 None admin] RBAC: Adding query filter params (name=member) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:05.378299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f547b-e56b-4f21-ad35-37ddf9a31525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:05.380704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f547b-e56b-4f21-ad35-37ddf9a31525 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:05.391686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 110/216] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:05.398050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.520470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c21a0-4d00-4370-bb1b-8d2575068d80 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:05.558020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:05.558954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.559238 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.559515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] PATH_INFO: `/v3/users/b77c1dbb651847ec822ccf2b855f321b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.577247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] RBAC: Authorizing `identity:get_user(user_id=b77c1dbb651847ec822ccf2b855f321b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:05.577426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf9cd-9eaf-4f00-a158-e3b6c2dc95cb None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.577636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf9cd-9eaf-4f00-a158-e3b6c2dc95cb None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.577870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf9cd-9eaf-4f00-a158-e3b6c2dc95cb None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.578767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:05.579418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 111/217] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:05.580573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 107/218] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/users/b77c1dbb651847ec822ccf2b855f321b => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:05.586212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.586361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626e19a-16b8-4d82-b2ea-b8f9774f1071 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.586556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626e19a-16b8-4d82-b2ea-b8f9774f1071 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.586781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626e19a-16b8-4d82-b2ea-b8f9774f1071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.606141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-1626e19a-16b8-4d82-b2ea-b8f9774f1071 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:05.607324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1626e19a-16b8-4d82-b2ea-b8f9774f1071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:05.689350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 112/219] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:05.700126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dafe3-b99f-4804-8f33-e5cf70148cbf None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:05.713253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626e19a-16b8-4d82-b2ea-b8f9774f1071 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.738508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:05.739171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.739732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.740014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.822394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:05.824147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:05.829321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626e19a-16b8-4d82-b2ea-b8f9774f1071 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:05.865210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:05.866040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:05.866320 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:05.866591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:05.877313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:05.886165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:05.887076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:05.887866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 113/220] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:05.896004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:05.930310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 108/221] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:31:05.935975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:06.009238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b58a-68dd-4375-be3a-62b33a5fdf92 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.041429 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1e90c-c2f2-45ca-b194-9a92ec6b3905 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.043600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.044270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.044554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.044832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.045580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:06.045917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:06.047316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:06.056507 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 114/222] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:06.062377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:06.083921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.084809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.085091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.085369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.086711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:06.088226 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:06.095215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 109/223] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:05 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:06.096565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:06.166340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537c813-5c35-46da-974c-fa9c34f5162f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.199026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d070e-3b6f-4768-a8ee-c8bb1c4424ca None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.200371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.201509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.201816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.202094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] PATH_INFO: `/v3/users/b08036a5cc14479ba3cd98deb664daca` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.203294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] RBAC: Authorizing `identity:get_user(user_id=b08036a5cc14479ba3cd98deb664daca)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:06.204744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:06.206795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 115/224] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:06 2022] GET /identity/v3/users/b08036a5cc14479ba3cd98deb664daca => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:06.212022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:06.235107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.235760 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.236045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.236321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.237165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=b77c1dbb651847ec822ccf2b855f321b) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:06.237478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:06.239684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:06.249838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 110/225] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:06 2022] GET /identity/v3/role_assignments?user.id=b77c1dbb651847ec822ccf2b855f321b&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:06.324070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521e075-ddea-4fdb-aa76-b5941a1ae9f3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.363596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8149070-fc93-4e83-91f7-fed91e4adb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.364478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8149070-fc93-4e83-91f7-fed91e4adb5f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.364760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8149070-fc93-4e83-91f7-fed91e4adb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.365038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8149070-fc93-4e83-91f7-fed91e4adb5f None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.366355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8149070-fc93-4e83-91f7-fed91e4adb5f None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:06.367841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8149070-fc93-4e83-91f7-fed91e4adb5f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:06.369925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 116/226] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:06 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:06.375673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:06.399649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc545f-a8a0-459a-8dce-78527788a29d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.399935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc545f-a8a0-459a-8dce-78527788a29d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.400224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc545f-a8a0-459a-8dce-78527788a29d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.401797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 117/227] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:06.407139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832de100-be4a-41e8-8cc3-7e489d215445 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.407423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832de100-be4a-41e8-8cc3-7e489d215445 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.407701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832de100-be4a-41e8-8cc3-7e489d215445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.437010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-832de100-be4a-41e8-8cc3-7e489d215445 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:06.438254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-832de100-be4a-41e8-8cc3-7e489d215445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:06.527311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 118/228] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:06.530506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268035be-3471-496a-b99e-ab4f44ba26af None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.550692 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832de100-be4a-41e8-8cc3-7e489d215445 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:06.573797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.574747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.574974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.575248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba/users/b08036a5cc14479ba3cd98deb664daca/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.582045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] RBAC: Authorizing `identity:create_grant(project_id=880cb7edf13147c39434b860982f24ba, user_id=b08036a5cc14479ba3cd98deb664daca, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:06.583844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:06.620137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 111/229] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:06 2022] PUT /identity/v3/projects/880cb7edf13147c39434b860982f24ba/users/b08036a5cc14479ba3cd98deb664daca/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:06.693624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832de100-be4a-41e8-8cc3-7e489d215445 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.736944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.737842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.738130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.738406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.754175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:06.762511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:06.763518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:06.764341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 119/230] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:06.770286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:06.903809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c2207-e72e-45e9-8cdf-0f8ba598852b None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:06.939859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:06.940631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:06.940830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:06.941111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:06.941932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:06.942243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:06.943622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:06.951888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 112/231] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:06.957843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:07.074259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ad98-a03d-463c-a2ab-e94028ac3be9 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:07.120310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:07.121253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:07.121619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:07.121922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] PATH_INFO: `/v3/users/b08036a5cc14479ba3cd98deb664daca` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:07.123218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] RBAC: Authorizing `identity:get_user(user_id=b08036a5cc14479ba3cd98deb664daca)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:07.124808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:07.126694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 120/232] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:06 2022] GET /identity/v3/users/b08036a5cc14479ba3cd98deb664daca => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:07.132170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:07.246909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef0afb-d04f-47d5-8f99-75ae2af93852 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:07.281386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827825e-bd4a-48f4-ade0-25c8283b25a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:07.282290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827825e-bd4a-48f4-ade0-25c8283b25a6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:07.282576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827825e-bd4a-48f4-ade0-25c8283b25a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:07.282856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827825e-bd4a-48f4-ade0-25c8283b25a6 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:07.284064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827825e-bd4a-48f4-ade0-25c8283b25a6 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:07.286168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827825e-bd4a-48f4-ade0-25c8283b25a6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:07.288060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 113/233] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:07 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:07.293920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:07.411023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ed004-34f9-4427-b704-a6da9e602976 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:07.454786 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052ef29-0385-45a1-bfe1-313670335450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:07.455680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ef29-0385-45a1-bfe1-313670335450 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:07.455964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ef29-0385-45a1-bfe1-313670335450 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:07.456782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ef29-0385-45a1-bfe1-313670335450 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba/users/b08036a5cc14479ba3cd98deb664daca/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:07.459087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052ef29-0385-45a1-bfe1-313670335450 None admin] RBAC: Authorizing `identity:create_grant(project_id=880cb7edf13147c39434b860982f24ba, user_id=b08036a5cc14479ba3cd98deb664daca, role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:07.460531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052ef29-0385-45a1-bfe1-313670335450 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:07.492202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 121/234] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:07 2022] PUT /identity/v3/projects/880cb7edf13147c39434b860982f24ba/users/b08036a5cc14479ba3cd98deb664daca/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:08.399243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e33a8d-13b8-4477-a2eb-cda08dc5113c None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:08.399766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e33a8d-13b8-4477-a2eb-cda08dc5113c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:08.399842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e33a8d-13b8-4477-a2eb-cda08dc5113c None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:08.401579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 114/235] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:08.407723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6b833-993d-4edb-820a-ed113737e37d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:08.408211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6b833-993d-4edb-820a-ed113737e37d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:08.408284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6b833-993d-4edb-820a-ed113737e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:08.430956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0ce6b833-993d-4edb-820a-ed113737e37d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:08.432148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0ce6b833-993d-4edb-820a-ed113737e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:08.511303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 122/236] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:08.535259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e33a8d-13b8-4477-a2eb-cda08dc5113c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:08.639137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e33a8d-13b8-4477-a2eb-cda08dc5113c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:08.672531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:08.673257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:08.673543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:08.673851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:08.684997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:08.693399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:08.694329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:08.695138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:08.699622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 115/237] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:08.701844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1be20-d688-4e12-babd-c9abe17519ab None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:08.702141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1be20-d688-4e12-babd-c9abe17519ab None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:08.702420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1be20-d688-4e12-babd-c9abe17519ab None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:08.703802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 123/238] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:08.704800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:08.709233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2e31-7bb5-4d02-a46e-3fd4a41859f7 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:08.709517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2e31-7bb5-4d02-a46e-3fd4a41859f7 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:08.709822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2e31-7bb5-4d02-a46e-3fd4a41859f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:08.750827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b96f2e31-7bb5-4d02-a46e-3fd4a41859f7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:08.752048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b96f2e31-7bb5-4d02-a46e-3fd4a41859f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:08.810135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca22986-55a5-4fec-9235-89c146990730 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:08.844378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:08.845057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:08.845340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:08.845617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:08.847064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:08.847473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:08.848852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:08.857680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 116/239] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:08.866657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:08.896661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 124/240] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:08.933297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f2e31-7bb5-4d02-a46e-3fd4a41859f7 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:08.967870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33407ea-d70b-4112-86c6-a2ace59d1928 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.001670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6382caa-5759-4cc1-afe0-5a4725cb4bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.003157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6382caa-5759-4cc1-afe0-5a4725cb4bda None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.003682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6382caa-5759-4cc1-afe0-5a4725cb4bda None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.003789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6382caa-5759-4cc1-afe0-5a4725cb4bda None admin] PATH_INFO: `/v3/users/339fe7aa546a4c7485ee2b185f9fabd0` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.017874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6382caa-5759-4cc1-afe0-5a4725cb4bda None admin] RBAC: Authorizing `identity:get_user(user_id=339fe7aa546a4c7485ee2b185f9fabd0)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.019943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6382caa-5759-4cc1-afe0-5a4725cb4bda None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.021651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 117/241] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:08 2022] GET /identity/v3/users/339fe7aa546a4c7485ee2b185f9fabd0 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:09.023054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c79ae5-5874-48dd-be6f-259c71ecfe36 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.023343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c79ae5-5874-48dd-be6f-259c71ecfe36 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.023618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c79ae5-5874-48dd-be6f-259c71ecfe36 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.024907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 118/242] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:09.029674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c79ae5-5874-48dd-be6f-259c71ecfe36 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.047377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f2e31-7bb5-4d02-a46e-3fd4a41859f7 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.084804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ded6f6-b5b7-464a-be5f-46892999d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.085972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded6f6-b5b7-464a-be5f-46892999d29b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.086456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded6f6-b5b7-464a-be5f-46892999d29b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.086953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded6f6-b5b7-464a-be5f-46892999d29b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.088344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ded6f6-b5b7-464a-be5f-46892999d29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.090049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ded6f6-b5b7-464a-be5f-46892999d29b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.091922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 125/243] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:09.093321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e6b1f-a527-4691-b303-2849765e15f6 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.093855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e6b1f-a527-4691-b303-2849765e15f6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.094495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e6b1f-a527-4691-b303-2849765e15f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.112674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2a4e6b1f-a527-4691-b303-2849765e15f6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:09.114223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2a4e6b1f-a527-4691-b303-2849765e15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:09.135737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c79ae5-5874-48dd-be6f-259c71ecfe36 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.170723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.171356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.171580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.171864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.185020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 126/244] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:09.186208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e6b1f-a527-4691-b303-2849765e15f6 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.263639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.265199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.288663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e6b1f-a527-4691-b303-2849765e15f6 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.325133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.326310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.326796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.327290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.328201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.329916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.355852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 127/245] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:09 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:09.357062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.368890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 119/246] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:09.374310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.475554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580564b6-3dd7-4daf-b8a3-a1bdbc927d77 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.510915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae5895-eb5d-4239-88a2-d2c22b14be1d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.524467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.525870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.526305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.526891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.542629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:09.548763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.549848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.550231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.550606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.551970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:09.552853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:09.553982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:09.555001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:09.556405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.557287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 128/247] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:09.561754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 120/248] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:09.563459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.564479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.671537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970bd4-5439-4e7f-9fbf-98ae70846b59 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.696274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809ecd-61bf-4cfd-8ee0-4f5995432134 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.716133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.717158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.718097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.718606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.719907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] RBAC: Adding query filter params (role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=339fe7aa546a4c7485ee2b185f9fabd0) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:09.720534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.723399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.732196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 121/249] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/role_assignments?user.id=339fe7aa546a4c7485ee2b185f9fabd0&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:09.740098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a3154-052a-4243-9b53-938f290691e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.741099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3154-052a-4243-9b53-938f290691e4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.741566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3154-052a-4243-9b53-938f290691e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.742116 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3154-052a-4243-9b53-938f290691e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.745744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a3154-052a-4243-9b53-938f290691e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:09.745744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a3154-052a-4243-9b53-938f290691e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.745744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a3154-052a-4243-9b53-938f290691e4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.758045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 129/250] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:09.763654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.801657 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6662e7-28bd-4e65-afe1-268454077dc2 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.801970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6662e7-28bd-4e65-afe1-268454077dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.802246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6662e7-28bd-4e65-afe1-268454077dc2 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.803957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 130/251] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:09.809470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c192fb-b337-4ddb-a47a-fdbfd66fd899 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.809791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c192fb-b337-4ddb-a47a-fdbfd66fd899 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.810072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c192fb-b337-4ddb-a47a-fdbfd66fd899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.834914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-78c192fb-b337-4ddb-a47a-fdbfd66fd899 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:09.836410 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-78c192fb-b337-4ddb-a47a-fdbfd66fd899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:09.903594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48c069-ba75-4343-b056-ee3375e2af47 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:09.927851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 131/252] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:09.943065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:09.944201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:09.944632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:09.945054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] PATH_INFO: `/v3/users/b77c1dbb651847ec822ccf2b855f321b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:09.946472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] RBAC: Authorizing `identity:get_user(user_id=b77c1dbb651847ec822ccf2b855f321b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:09.948099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:09.950585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 122/253] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/users/b77c1dbb651847ec822ccf2b855f321b => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:09.955120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c192fb-b337-4ddb-a47a-fdbfd66fd899 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:09.956185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.084731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c192fb-b337-4ddb-a47a-fdbfd66fd899 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.099793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9ced-17c1-4e6d-b5d6-918a31dfd5f5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.124645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.125445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.125743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.126024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.137257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:10.144997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:10.145921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:10.146951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:10.147562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.147562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.147717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 132/254] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:10.147784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.147784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.150442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:10.151932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:10.153656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 123/255] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:09 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:10.157109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.158957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.262581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5161a-80c1-4010-a904-cbc16ee03b45 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.264641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b33c87-9756-4201-b168-ab291ffd3447 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.298115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853a5f8-d08c-4966-87c6-15bed40b787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.298795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a5f8-d08c-4966-87c6-15bed40b787d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.299108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a5f8-d08c-4966-87c6-15bed40b787d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.299892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a5f8-d08c-4966-87c6-15bed40b787d None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.300648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853a5f8-d08c-4966-87c6-15bed40b787d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:10.300962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853a5f8-d08c-4966-87c6-15bed40b787d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:10.302427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853a5f8-d08c-4966-87c6-15bed40b787d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:10.311238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 133/256] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:10.313217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8cb2a-526d-4b24-bc1e-f65e6e170c55 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.313217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8cb2a-526d-4b24-bc1e-f65e6e170c55 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.313217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8cb2a-526d-4b24-bc1e-f65e6e170c55 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.314752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 134/257] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:10.318950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c4de-53b6-4df0-8d75-2306a9ee137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.320043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c4de-53b6-4df0-8d75-2306a9ee137a None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.320472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c4de-53b6-4df0-8d75-2306a9ee137a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.321143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c4de-53b6-4df0-8d75-2306a9ee137a None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba/users/b77c1dbb651847ec822ccf2b855f321b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.321831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8cb2a-526d-4b24-bc1e-f65e6e170c55 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.323484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c4de-53b6-4df0-8d75-2306a9ee137a None admin] RBAC: Authorizing `identity:create_grant(project_id=880cb7edf13147c39434b860982f24ba, user_id=b77c1dbb651847ec822ccf2b855f321b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:10.325356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c4de-53b6-4df0-8d75-2306a9ee137a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:10.348334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 124/258] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:10 2022] PUT /identity/v3/projects/880cb7edf13147c39434b860982f24ba/users/b77c1dbb651847ec822ccf2b855f321b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:31:10.353724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779001-9b1b-45e9-a3a3-d4a29d73fd43 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.353724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779001-9b1b-45e9-a3a3-d4a29d73fd43 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.353724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779001-9b1b-45e9-a3a3-d4a29d73fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.369410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-af779001-9b1b-45e9-a3a3-d4a29d73fd43 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:10.370812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-af779001-9b1b-45e9-a3a3-d4a29d73fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:10.451460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 125/259] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:10.478322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779001-9b1b-45e9-a3a3-d4a29d73fd43 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.539472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8cb2a-526d-4b24-bc1e-f65e6e170c55 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.593058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779001-9b1b-45e9-a3a3-d4a29d73fd43 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.628037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.628843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.629131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.629400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] PATH_INFO: `/v3/users/b08036a5cc14479ba3cd98deb664daca` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.631672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.632475 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.632754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.633023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.634464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] RBAC: Authorizing `identity:get_user(user_id=b08036a5cc14479ba3cd98deb664daca)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:10.635940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:10.638037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 135/260] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:10 2022] GET /identity/v3/users/b08036a5cc14479ba3cd98deb664daca => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:10.644039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.645087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:10.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:10.654713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:10.655696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:10.656371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 126/261] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:10.662788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.784046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0140b5-b54a-49d1-af49-1ed228b1b152 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.822278 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a773e6c-c309-4d4f-ab30-2062c110df6a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:10.824369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.825540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.826038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.826507 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.873753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:10.874398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:10.874675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:10.874943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:10.875691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:10.876029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:10.878177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:10.886788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 127/262] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:10.892542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:10.916526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:10.918367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:11.018427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 136/263] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:31:11.024444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:11.047493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84398-cd31-41ea-849e-7ee7ca58bcc8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:11.099834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:11.100702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:11.100975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:11.101242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] PATH_INFO: `/v3/users/b08036a5cc14479ba3cd98deb664daca` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:11.106542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] RBAC: Authorizing `identity:get_user(user_id=b08036a5cc14479ba3cd98deb664daca)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:11.108021 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:11.109987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 128/264] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:10 2022] GET /identity/v3/users/b08036a5cc14479ba3cd98deb664daca => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:11.115293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:11.129548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c681-9523-4036-9da0-c5c2df074074 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:11.173417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:11.175882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:11.176363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:11.180959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:11.182449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:11.184105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:11.192234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 137/265] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:11 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:11.213967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:11.313075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53117-2d64-422b-bf6f-a570be1c3dfb None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:11.378510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:11.379508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:11.380041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:11.380513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:11.399026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ece1-26da-4445-8d5d-5f9a5ba306ae None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:11.438362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:11.440050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:11.440700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:11.442204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:11.443267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=b08036a5cc14479ba3cd98deb664daca) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:11.444420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:11.446700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:11.463483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 138/266] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:11 2022] GET /identity/v3/role_assignments?user.id=b08036a5cc14479ba3cd98deb664daca&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:11.512839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:11.514697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:11.638544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 129/267] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:31:11.644385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:11.750428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613025-3e02-476b-8d89-56fbe599a3c2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:11.791483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056c466-a2c3-4002-830f-9ea1b5693630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:11.792370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c466-a2c3-4002-830f-9ea1b5693630 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:11.792649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c466-a2c3-4002-830f-9ea1b5693630 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:11.792919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c466-a2c3-4002-830f-9ea1b5693630 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:11.794167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056c466-a2c3-4002-830f-9ea1b5693630 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:11.795704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056c466-a2c3-4002-830f-9ea1b5693630 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:11.797730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 139/268] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:11 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:11.804068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:11.946677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f9b5-cac4-45a9-ba99-fc707024b3a0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:11.988794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79fa5b-7076-4eab-8f01-d38c57b24865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:11.989866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79fa5b-7076-4eab-8f01-d38c57b24865 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:11.990350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79fa5b-7076-4eab-8f01-d38c57b24865 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:11.990823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79fa5b-7076-4eab-8f01-d38c57b24865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:11.991863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79fa5b-7076-4eab-8f01-d38c57b24865 None admin] RBAC: Adding query filter params (role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=b08036a5cc14479ba3cd98deb664daca) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:11.992404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79fa5b-7076-4eab-8f01-d38c57b24865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:11.994061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79fa5b-7076-4eab-8f01-d38c57b24865 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:12.001009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 130/269] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:11 2022] GET /identity/v3/role_assignments?user.id=b08036a5cc14479ba3cd98deb664daca&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:12.407710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156c05-93ba-4352-b98f-5e31befb7f4d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:12.408128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156c05-93ba-4352-b98f-5e31befb7f4d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:12.408898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156c05-93ba-4352-b98f-5e31befb7f4d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:12.410297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 140/270] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:12.416512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6410-bbb5-437c-9dff-d7ef4e35fbd5 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:12.416802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6410-bbb5-437c-9dff-d7ef4e35fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:12.417076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6410-bbb5-437c-9dff-d7ef4e35fbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:12.434441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-93ce6410-bbb5-437c-9dff-d7ef4e35fbd5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:12.435622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-93ce6410-bbb5-437c-9dff-d7ef4e35fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:12.520940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 131/271] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:12.545892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156c05-93ba-4352-b98f-5e31befb7f4d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:12.652476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156c05-93ba-4352-b98f-5e31befb7f4d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:12.687622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:12.688734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:12.689273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:12.690301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:12.701122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:12.709266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:12.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:12.710963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:12.713804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 141/272] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:12.721191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6410-bbb5-437c-9dff-d7ef4e35fbd5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:12.831750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6410-bbb5-437c-9dff-d7ef4e35fbd5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:12.870737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:12.871748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:12.872226 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:12.872718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:12.873661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:12.874210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:12.875786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:12.885426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 132/273] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:12.890680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:12.997345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a101e77-512b-4151-84c7-d3ded520eeea None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.032258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.034093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.034598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.035067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] PATH_INFO: `/v3/users/339fe7aa546a4c7485ee2b185f9fabd0` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.036659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] RBAC: Authorizing `identity:get_user(user_id=339fe7aa546a4c7485ee2b185f9fabd0)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:13.038401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:13.040685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 142/274] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:12 2022] GET /identity/v3/users/339fe7aa546a4c7485ee2b185f9fabd0 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:13.046857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.153225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd27e3-322d-4dbf-9e5f-8d507760a2b7 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.187017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85024-6247-42d3-b397-d49eec6a586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.188249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85024-6247-42d3-b397-d49eec6a586d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.188722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85024-6247-42d3-b397-d49eec6a586d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.189214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85024-6247-42d3-b397-d49eec6a586d None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.190699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85024-6247-42d3-b397-d49eec6a586d None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:13.192356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85024-6247-42d3-b397-d49eec6a586d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:13.194568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 133/275] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:13.202820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.219961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9527-f823-4df0-ae5d-7498607b4cb1 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.220252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9527-f823-4df0-ae5d-7498607b4cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.221094 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9527-f823-4df0-ae5d-7498607b4cb1 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.223807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 134/276] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:13.227793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224c63-1d9a-43c0-8309-07fcbfac21ec None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.228113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224c63-1d9a-43c0-8309-07fcbfac21ec None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.228372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224c63-1d9a-43c0-8309-07fcbfac21ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.247037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-34224c63-1d9a-43c0-8309-07fcbfac21ec None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:13.248279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-34224c63-1d9a-43c0-8309-07fcbfac21ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:13.312730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880f06c-675a-466c-a36e-f9eb4cd23f0d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.320918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 135/277] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:13.325613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7649a89-cd4a-4057-bfd5-6543e3a4fb8c None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.325613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7649a89-cd4a-4057-bfd5-6543e3a4fb8c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.325613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7649a89-cd4a-4057-bfd5-6543e3a4fb8c None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.325613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 136/278] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:13.331056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db67280-2a42-4c83-9642-180881ef4767 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.331338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db67280-2a42-4c83-9642-180881ef4767 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.331614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db67280-2a42-4c83-9642-180881ef4767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.350392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6db67280-2a42-4c83-9642-180881ef4767 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:13.351567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6db67280-2a42-4c83-9642-180881ef4767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:13.356501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.357621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.358086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.358536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba/users/339fe7aa546a4c7485ee2b185f9fabd0/roles/7a8626fbf5cd4b0aadd9a8a49fc6c3f6` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.360647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] RBAC: Authorizing `identity:create_grant(project_id=880cb7edf13147c39434b860982f24ba, user_id=339fe7aa546a4c7485ee2b185f9fabd0, role_id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:13.362168 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:13.375953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 143/279] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:13 2022] PUT /identity/v3/projects/880cb7edf13147c39434b860982f24ba/users/339fe7aa546a4c7485ee2b185f9fabd0/roles/7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:13.376922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.431309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 137/280] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:13.466317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db67280-2a42-4c83-9642-180881ef4767 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.517845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b96d6d-96d7-44b3-baef-2402b23b6295 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.552035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2f76d-7bca-411f-a12e-3b6667dc995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.552839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f76d-7bca-411f-a12e-3b6667dc995d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.553296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f76d-7bca-411f-a12e-3b6667dc995d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.553579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f76d-7bca-411f-a12e-3b6667dc995d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.564924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2f76d-7bca-411f-a12e-3b6667dc995d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:13.570729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db67280-2a42-4c83-9642-180881ef4767 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-42a2f76d-7bca-411f-a12e-3b6667dc995d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:13.573252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:13.574601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:13.575421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 144/281] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:13.576690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8252d-75d0-43f5-8437-e4c757a54c25 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.576690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8252d-75d0-43f5-8437-e4c757a54c25 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.576950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8252d-75d0-43f5-8437-e4c757a54c25 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.579225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 145/282] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:13.582625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8252d-75d0-43f5-8437-e4c757a54c25 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.615138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba493a-9f29-4a02-8ed7-86ff5eeed17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.615939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba493a-9f29-4a02-8ed7-86ff5eeed17e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.616218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba493a-9f29-4a02-8ed7-86ff5eeed17e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.616494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba493a-9f29-4a02-8ed7-86ff5eeed17e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.627402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba493a-9f29-4a02-8ed7-86ff5eeed17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-16ba493a-9f29-4a02-8ed7-86ff5eeed17e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:13.635145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:13.636019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:13.636837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 138/283] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:13.638025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043cee-0e16-491c-9777-e54913f9f172 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.638135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043cee-0e16-491c-9777-e54913f9f172 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.638398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043cee-0e16-491c-9777-e54913f9f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.656901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-73043cee-0e16-491c-9777-e54913f9f172 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:13.658137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-73043cee-0e16-491c-9777-e54913f9f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:13.687710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8252d-75d0-43f5-8437-e4c757a54c25 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.722165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.722594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 139/284] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:13.723015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.723111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.723353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.724100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] RBAC: Adding query filter params (name=member) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:13.724405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:13.726997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:13.727193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73043cee-0e16-491c-9777-e54913f9f172 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.741695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 146/285] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:13.748002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.826795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73043cee-0e16-491c-9777-e54913f9f172 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.855569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b71ba-b9b9-4f0f-97f8-8ba2eb720691 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:13.859108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.859776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.860056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.860354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.861617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:13.861967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:13.863346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:13.871287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 140/286] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:13.872077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.895869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:13.896886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:13.897158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:13.897429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] PATH_INFO: `/v3/users/ae7376d6cb8b46048ca4cba53459e0b5` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:13.910660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] RBAC: Authorizing `identity:get_user(user_id=ae7376d6cb8b46048ca4cba53459e0b5)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:13.912217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:13.913943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 147/287] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/users/ae7376d6cb8b46048ca4cba53459e0b5 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:13.919173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:13.972524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eb5a3-01f1-4624-a6bc-503186bb84be None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:14.006401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:14.007189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:14.007471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:14.007763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:14.008949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:14.010509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:14.012273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 141/288] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:14.012874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:14.019677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfc769-ec31-4297-9017-b85b3b461df3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:14.061957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:14.062830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:14.063113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:14.063390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] PATH_INFO: `/v3/users/b77c1dbb651847ec822ccf2b855f321b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:14.065079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] RBAC: Authorizing `identity:get_user(user_id=b77c1dbb651847ec822ccf2b855f321b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:14.066552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:14.068185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 148/289] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:13 2022] GET /identity/v3/users/b77c1dbb651847ec822ccf2b855f321b => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:14.068925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:14.128314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce23ec-3065-4194-809d-776070fa4838 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:14.161447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:14.162148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:14.162443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:14.162708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:14.163544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, user.id=ae7376d6cb8b46048ca4cba53459e0b5, scope.system=all) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:14.163863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:14.165284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:14.170313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 142/290] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 12 11:31:14 2022] GET /identity/v3/role_assignments?user.id=ae7376d6cb8b46048ca4cba53459e0b5&scope.system=all&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:14.174333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4022-0894-4a11-b781-8025badf8e57 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:14.182768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:14.212535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:14.213469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:14.213928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:14.214392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:14.215210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:14.216700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:14.242573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 149/291] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:14 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:14.323010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0ecf-b298-4122-849c-96489fea4808 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:14.365562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:14.366508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:14.366935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:14.367551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:14.443077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:14.444778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:14.547442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 143/292] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:14.553089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:14.669240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d7ce-e12a-43d1-80ce-b94c2c625dbb None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:14.706019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674c3c-f310-4f7c-be54-1923d580061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:14.706794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674c3c-f310-4f7c-be54-1923d580061a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:14.707071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674c3c-f310-4f7c-be54-1923d580061a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:14.707342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674c3c-f310-4f7c-be54-1923d580061a None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:14.708526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674c3c-f310-4f7c-be54-1923d580061a None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:14.709982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674c3c-f310-4f7c-be54-1923d580061a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:14.711734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 150/293] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:14 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:14.718010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:14.824176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82104778-f5e3-447f-8da9-3deed675d0e9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:14.865073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441512d-1196-4b9a-82ea-2433bcd96883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:14.865748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441512d-1196-4b9a-82ea-2433bcd96883 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:14.866038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441512d-1196-4b9a-82ea-2433bcd96883 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:14.866313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441512d-1196-4b9a-82ea-2433bcd96883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:14.867145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441512d-1196-4b9a-82ea-2433bcd96883 None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=b77c1dbb651847ec822ccf2b855f321b) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:14.867454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441512d-1196-4b9a-82ea-2433bcd96883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:14.868886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441512d-1196-4b9a-82ea-2433bcd96883 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:14.881113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 144/294] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:14 2022] GET /identity/v3/role_assignments?user.id=b77c1dbb651847ec822ccf2b855f321b&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:15.725923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80139a7-4caa-4ebb-b9d5-b616c9b2ca56 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:15.726419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80139a7-4caa-4ebb-b9d5-b616c9b2ca56 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:15.726522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80139a7-4caa-4ebb-b9d5-b616c9b2ca56 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:15.728092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 151/295] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:15.733565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c107b7-ae6a-417c-900b-16b6ae5a2864 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:15.733892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c107b7-ae6a-417c-900b-16b6ae5a2864 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:15.734174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c107b7-ae6a-417c-900b-16b6ae5a2864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:15.751264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f0c107b7-ae6a-417c-900b-16b6ae5a2864 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:15.752487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f0c107b7-ae6a-417c-900b-16b6ae5a2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:15.818529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 145/296] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:15.841321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80139a7-4caa-4ebb-b9d5-b616c9b2ca56 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:15.945093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80139a7-4caa-4ebb-b9d5-b616c9b2ca56 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:15.979787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:15.980577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:15.980856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:15.981131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:15.991818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:15.999363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:16.000255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:16.001604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 152/297] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:16.007140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c107b7-ae6a-417c-900b-16b6ae5a2864 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:16.106377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c107b7-ae6a-417c-900b-16b6ae5a2864 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:16.140702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:16.141368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.142228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.142510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.143264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:16.143569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:16.144956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:16.157919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 146/298] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:16.159725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:16.259070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a9b14-8b08-423b-a27b-1344c6df6395 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:16.293040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d6adc-53ce-42f5-87a9-eaa552a062e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:16.293949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6adc-53ce-42f5-87a9-eaa552a062e2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.294229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6adc-53ce-42f5-87a9-eaa552a062e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.294505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6adc-53ce-42f5-87a9-eaa552a062e2 None admin] PATH_INFO: `/v3/users/339fe7aa546a4c7485ee2b185f9fabd0` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.295705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d6adc-53ce-42f5-87a9-eaa552a062e2 None admin] RBAC: Authorizing `identity:get_user(user_id=339fe7aa546a4c7485ee2b185f9fabd0)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:16.297154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d6adc-53ce-42f5-87a9-eaa552a062e2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:16.303418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 153/299] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/users/339fe7aa546a4c7485ee2b185f9fabd0 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:16.304796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:16.410158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aa1ff-abac-4480-b97e-ee3af99c5207 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:16.444980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:16.445627 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.445949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.446221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.519464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:16.521284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:16.560428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb2c7-4e44-4dd6-91db-d7aac70aa9f9 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.560428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb2c7-4e44-4dd6-91db-d7aac70aa9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.560673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb2c7-4e44-4dd6-91db-d7aac70aa9f9 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.562284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 154/300] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:16.567420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253880-90f8-42d6-8f19-79488bd2a3d6 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.567705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253880-90f8-42d6-8f19-79488bd2a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.567981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253880-90f8-42d6-8f19-79488bd2a3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.585073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f9253880-90f8-42d6-8f19-79488bd2a3d6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:16.586320 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f9253880-90f8-42d6-8f19-79488bd2a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:16.630623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 147/301] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:16.637151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:16.677955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 155/302] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:16.700382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253880-90f8-42d6-8f19-79488bd2a3d6 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:16.743830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b794e-3f1c-4af4-b28e-7a8aa57bb5ca None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:16.778425 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080d40e-4aea-4c0a-be7c-674a6321e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:16.779599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d40e-4aea-4c0a-be7c-674a6321e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.780086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d40e-4aea-4c0a-be7c-674a6321e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.780556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d40e-4aea-4c0a-be7c-674a6321e3b2 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.781990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080d40e-4aea-4c0a-be7c-674a6321e3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:16.783960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080d40e-4aea-4c0a-be7c-674a6321e3b2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:16.785851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 148/303] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:16.791043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79906c83-c52f-471a-826d-4ed7605fb5b0 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.791327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79906c83-c52f-471a-826d-4ed7605fb5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.791603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79906c83-c52f-471a-826d-4ed7605fb5b0 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.793015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 149/304] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:16.793738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79906c83-c52f-471a-826d-4ed7605fb5b0 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:16.814785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253880-90f8-42d6-8f19-79488bd2a3d6 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:16.847924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a644b-524d-48c7-963a-a6eeec239067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:16.849031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a644b-524d-48c7-963a-a6eeec239067 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.849380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a644b-524d-48c7-963a-a6eeec239067 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.849662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a644b-524d-48c7-963a-a6eeec239067 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.859650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a644b-524d-48c7-963a-a6eeec239067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-003a644b-524d-48c7-963a-a6eeec239067 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:16.867854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:16.868803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:16.869604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 156/305] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:16.870968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089d9f1-7742-434e-a0e5-e3b65d87783a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.870968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089d9f1-7742-434e-a0e5-e3b65d87783a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.870968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089d9f1-7742-434e-a0e5-e3b65d87783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.894437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-4089d9f1-7742-434e-a0e5-e3b65d87783a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:16.895637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4089d9f1-7742-434e-a0e5-e3b65d87783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:16.899934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79906c83-c52f-471a-826d-4ed7605fb5b0 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:16.934255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:16.934962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:16.935249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:16.935548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:16.936394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] RBAC: Adding query filter params (role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6, scope.project.id=880cb7edf13147c39434b860982f24ba, user.id=339fe7aa546a4c7485ee2b185f9fabd0) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:16.936708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:16.938345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:16.952719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 150/306] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/role_assignments?user.id=339fe7aa546a4c7485ee2b185f9fabd0&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:16.952719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:16.967011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 157/307] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:16.990556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089d9f1-7742-434e-a0e5-e3b65d87783a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.066806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1c249-f044-492a-840d-7ee56f0cd3bd None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.096984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089d9f1-7742-434e-a0e5-e3b65d87783a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.101873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c81453-1ccf-4c0e-840e-b3291262a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.102556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81453-1ccf-4c0e-840e-b3291262a804 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.102838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81453-1ccf-4c0e-840e-b3291262a804 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.103113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81453-1ccf-4c0e-840e-b3291262a804 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.103873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81453-1ccf-4c0e-840e-b3291262a804 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:17.104178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81453-1ccf-4c0e-840e-b3291262a804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.105598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81453-1ccf-4c0e-840e-b3291262a804 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.115199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 151/308] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:17.116555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf895aa-36f5-43f2-8770-98e2d2103333 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.116846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf895aa-36f5-43f2-8770-98e2d2103333 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.117124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf895aa-36f5-43f2-8770-98e2d2103333 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.118632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 152/309] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:17.121842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf895aa-36f5-43f2-8770-98e2d2103333 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.133899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236e30e-0892-4bca-926c-777f0eb1f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.134703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236e30e-0892-4bca-926c-777f0eb1f24f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.135007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236e30e-0892-4bca-926c-777f0eb1f24f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.135287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236e30e-0892-4bca-926c-777f0eb1f24f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.146957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236e30e-0892-4bca-926c-777f0eb1f24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a236e30e-0892-4bca-926c-777f0eb1f24f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:17.154699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:17.155742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:17.156737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 158/310] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:17.158232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21456cc-f304-4f08-8529-457b38b52249 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.158232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21456cc-f304-4f08-8529-457b38b52249 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.158232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21456cc-f304-4f08-8529-457b38b52249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.174621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d21456cc-f304-4f08-8529-457b38b52249 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:17.175908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d21456cc-f304-4f08-8529-457b38b52249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:17.234561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf895aa-36f5-43f2-8770-98e2d2103333 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.243300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 159/311] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:17.254167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21456cc-f304-4f08-8529-457b38b52249 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.276671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.277533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.277838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.278112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] PATH_INFO: `/v3/users/ae7376d6cb8b46048ca4cba53459e0b5` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.279275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] RBAC: Authorizing `identity:get_user(user_id=ae7376d6cb8b46048ca4cba53459e0b5)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.280695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.282378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 153/312] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:17 2022] GET /identity/v3/users/ae7376d6cb8b46048ca4cba53459e0b5 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:17.283125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.339555 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21456cc-f304-4f08-8529-457b38b52249 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.370473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.371121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.371398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.371667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.372402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:17.372702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.374082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.376415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f229c1b-25e3-407a-b671-151f21c5c87c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.382256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 160/313] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:17.383006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.409112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.409927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.410210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.410484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.411641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.413065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.414867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 154/314] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:17.416071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.477323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213308e-e723-400e-aef5-023c97578d2a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.509983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.510841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.511128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.511400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] PATH_INFO: `/v3/system/users/ae7376d6cb8b46048ca4cba53459e0b5/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.512866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ae7376d6cb8b46048ca4cba53459e0b5, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.512968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f2f37-22d8-4580-80f7-8f84c7a57ed1 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.514272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.523026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 161/315] 10.222.0.58 () {58 vars in 1334 bytes} [Thu May 12 11:31:17 2022] PUT /identity/v3/system/users/ae7376d6cb8b46048ca4cba53459e0b5/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:17.523806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.549224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.550282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.550626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.550964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] PATH_INFO: `/v3/users/6b95fe3c1d314209abf89530dfc75e80` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.567168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] RBAC: Authorizing `identity:get_user(user_id=6b95fe3c1d314209abf89530dfc75e80)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.568775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.570824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 155/316] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:17 2022] GET /identity/v3/users/6b95fe3c1d314209abf89530dfc75e80 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:17.576638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:17.630210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dc69a-e61b-44cc-b1a4-094249b0c3eb None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.664947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d26a-a976-4354-a03e-4937008a925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.665736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d26a-a976-4354-a03e-4937008a925d None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.666094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d26a-a976-4354-a03e-4937008a925d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.666444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d26a-a976-4354-a03e-4937008a925d None admin] PATH_INFO: `/v3/groups` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.667202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d26a-a976-4354-a03e-4937008a925d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.668723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d26a-a976-4354-a03e-4937008a925d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.679327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592791c-e875-47e6-bda3-3dcffab053a5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:17.684501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 162/317] 10.222.0.58 () {60 vars in 1134 bytes} [Thu May 12 11:31:17 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:17.719850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff8d9d-4f99-4481-b63a-4a385f87ec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:17.720515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8d9d-4f99-4481-b63a-4a385f87ec78 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:17.720793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8d9d-4f99-4481-b63a-4a385f87ec78 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:17.721062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff8d9d-4f99-4481-b63a-4a385f87ec78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:17.721975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff8d9d-4f99-4481-b63a-4a385f87ec78 None admin] RBAC: Adding query filter params (role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6, user.id=6b95fe3c1d314209abf89530dfc75e80, scope.system=all) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:17.722283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff8d9d-4f99-4481-b63a-4a385f87ec78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:17.723755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff8d9d-4f99-4481-b63a-4a385f87ec78 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:17.729535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 156/318] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 12 11:31:17 2022] GET /identity/v3/role_assignments?user.id=6b95fe3c1d314209abf89530dfc75e80&scope.system=all&role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:19.807146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53bc2a-9f07-4524-88d9-185c7f5990b9 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:19.807655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53bc2a-9f07-4524-88d9-185c7f5990b9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:19.807655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53bc2a-9f07-4524-88d9-185c7f5990b9 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:19.809010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 163/319] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:19.814381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b7bb-d6ce-40fc-807a-55d026305e27 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:19.814765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b7bb-d6ce-40fc-807a-55d026305e27 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:19.814938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b7bb-d6ce-40fc-807a-55d026305e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:19.831900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8755b7bb-d6ce-40fc-807a-55d026305e27 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:19.833080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8755b7bb-d6ce-40fc-807a-55d026305e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:19.898724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 157/320] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:19.922974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53bc2a-9f07-4524-88d9-185c7f5990b9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:19.949746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb35f5-571f-4fca-abd0-05bb58100da4 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:19.950051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb35f5-571f-4fca-abd0-05bb58100da4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:19.950302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb35f5-571f-4fca-abd0-05bb58100da4 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:19.951829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 158/321] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:19.956690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2b3ff-82e5-49e5-a1e5-9f7581beb2d8 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:19.956974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2b3ff-82e5-49e5-a1e5-9f7581beb2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:19.957248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2b3ff-82e5-49e5-a1e5-9f7581beb2d8 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:19.958488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 159/322] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:19.959524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95652-2cec-47ee-8ae6-00aea5806bd1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:19.959797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95652-2cec-47ee-8ae6-00aea5806bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:19.960068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95652-2cec-47ee-8ae6-00aea5806bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:19.976424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-85e95652-2cec-47ee-8ae6-00aea5806bd1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:19.977578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-85e95652-2cec-47ee-8ae6-00aea5806bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:20.021117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53bc2a-9f07-4524-88d9-185c7f5990b9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.039275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 160/323] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:20.040501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7836c-06ac-4c44-8b9b-bba228ea36dc None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.040791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7836c-06ac-4c44-8b9b-bba228ea36dc None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.041081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7836c-06ac-4c44-8b9b-bba228ea36dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.055175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.056231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.056653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-68e7836c-06ac-4c44-8b9b-bba228ea36dc None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:20.056831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.057298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.057826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-68e7836c-06ac-4c44-8b9b-bba228ea36dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:20.068684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:20.076553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:20.077442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:20.078299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 164/324] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:20.078958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.121706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 161/325] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:20.122583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7836c-06ac-4c44-8b9b-bba228ea36dc None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.174332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9133d-c2ea-460d-9a4f-6ced6acd83f7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.206182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.206960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.207242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.207516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.215346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7836c-06ac-4c44-8b9b-bba228ea36dc None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.217319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:20.225562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:20.226499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:20.227295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 165/326] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:20.227962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.248724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.249383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.249666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.249976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.251228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:20.251538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.252900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.260798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 162/327] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:20.261497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.326528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686c9d3-d603-48e0-886a-90c0015718ad None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.355445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf420f1-bf10-4ed7-aaee-3caec364b050 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.358892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.359714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.359981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.360294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.361500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.363000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.364632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 166/328] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:20.365397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.387834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.388493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.388783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.389058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.389826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:20.390136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.392045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.399964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 163/329] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:20.400539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.459712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654334f-c9e9-48f2-b611-3ff3488065c6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.490627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.491478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.491758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.492026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] PATH_INFO: `/v3/users/ae7376d6cb8b46048ca4cba53459e0b5` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.493185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] RBAC: Authorizing `identity:get_user(user_id=ae7376d6cb8b46048ca4cba53459e0b5)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.493527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f97b-9897-4615-bb61-e669ca91fb76 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.494668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.496469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 167/330] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:20 2022] GET /identity/v3/users/ae7376d6cb8b46048ca4cba53459e0b5 => generated 293 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:20.501257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.526848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.527512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.527795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.528078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] PATH_INFO: `/v3/groups` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.528762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.530237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.544566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 164/331] 10.222.0.58 () {60 vars in 1134 bytes} [Thu May 12 11:31:20 2022] POST /identity/v3/groups => generated 226 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:20.545513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.600457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379eabe-1d11-43bb-abe6-9e9273d5e4ea None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.636647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.637591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.637902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.638183 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] PATH_INFO: `/v3/users/6b95fe3c1d314209abf89530dfc75e80` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.639458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] RBAC: Authorizing `identity:get_user(user_id=6b95fe3c1d314209abf89530dfc75e80)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.641488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.643399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 168/332] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:20 2022] GET /identity/v3/users/6b95fe3c1d314209abf89530dfc75e80 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:20.648958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:20.658000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097eaf6-a6b0-46a4-894b-11e4bb97116c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.693919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4fa6a-ec62-475e-a212-d7fb235327b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.694703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fa6a-ec62-475e-a212-d7fb235327b1 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.694989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fa6a-ec62-475e-a212-d7fb235327b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.695267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4fa6a-ec62-475e-a212-d7fb235327b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.696123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4fa6a-ec62-475e-a212-d7fb235327b1 None admin] RBAC: Adding query filter params (role.id=4f6317917e894e6eb35b5ac8f7ca0b64, user.id=ae7376d6cb8b46048ca4cba53459e0b5, scope.system=all) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:20.696444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4fa6a-ec62-475e-a212-d7fb235327b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.698224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4fa6a-ec62-475e-a212-d7fb235327b1 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.710602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 165/333] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 12 11:31:20 2022] GET /identity/v3/role_assignments?user.id=ae7376d6cb8b46048ca4cba53459e0b5&scope.system=all&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:20.756761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02699ffe-a15c-4efa-8a4c-81878a51911c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:20.794509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3765fbd-437a-48eb-8db9-b44221e029ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:20.795389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765fbd-437a-48eb-8db9-b44221e029ab None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:20.795672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765fbd-437a-48eb-8db9-b44221e029ab None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:20.795948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765fbd-437a-48eb-8db9-b44221e029ab None admin] PATH_INFO: `/v3/system/users/6b95fe3c1d314209abf89530dfc75e80/roles/7a8626fbf5cd4b0aadd9a8a49fc6c3f6` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:20.798169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3765fbd-437a-48eb-8db9-b44221e029ab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6b95fe3c1d314209abf89530dfc75e80, role_id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:20.799614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3765fbd-437a-48eb-8db9-b44221e029ab None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:20.808398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 169/334] 10.222.0.58 () {58 vars in 1334 bytes} [Thu May 12 11:31:20 2022] PUT /identity/v3/system/users/6b95fe3c1d314209abf89530dfc75e80/roles/7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:31:23.367057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa1ecc-042a-4806-9904-16357cc0fc21 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.368073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa1ecc-042a-4806-9904-16357cc0fc21 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.368554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa1ecc-042a-4806-9904-16357cc0fc21 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.370465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 166/335] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:23.376247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95bcd-7d80-42ec-af91-a8fb271c10f4 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.376658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95bcd-7d80-42ec-af91-a8fb271c10f4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.376832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95bcd-7d80-42ec-af91-a8fb271c10f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.398425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f7a95bcd-7d80-42ec-af91-a8fb271c10f4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:23.399617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f7a95bcd-7d80-42ec-af91-a8fb271c10f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:23.486709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 170/336] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:23.521959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff53c-43ad-4f62-b09b-1dd84e9fca55 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.522327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff53c-43ad-4f62-b09b-1dd84e9fca55 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.522612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff53c-43ad-4f62-b09b-1dd84e9fca55 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.524386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 167/337] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:23.529954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704af4-2c9a-44dc-b2dc-01887cff5f83 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.530253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704af4-2c9a-44dc-b2dc-01887cff5f83 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.530514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704af4-2c9a-44dc-b2dc-01887cff5f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.533106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ff53c-43ad-4f62-b09b-1dd84e9fca55 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:23.554874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e6704af4-2c9a-44dc-b2dc-01887cff5f83 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:23.556098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e6704af4-2c9a-44dc-b2dc-01887cff5f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:23.650502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 171/338] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:23.666467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ff53c-43ad-4f62-b09b-1dd84e9fca55 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:23.675872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704af4-2c9a-44dc-b2dc-01887cff5f83 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:23.732608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:23.733823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.734840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.735313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.751461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:23.760596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:23.761567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:23.762444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:23.765199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 168/339] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:23.770666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:23.810171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704af4-2c9a-44dc-b2dc-01887cff5f83 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:23.855354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6114eb-4942-4e4e-90a9-02f9c7c5f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:23.856167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6114eb-4942-4e4e-90a9-02f9c7c5f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.856451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6114eb-4942-4e4e-90a9-02f9c7c5f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.856726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6114eb-4942-4e4e-90a9-02f9c7c5f4c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.876825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6114eb-4942-4e4e-90a9-02f9c7c5f4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-ab6114eb-4942-4e4e-90a9-02f9c7c5f4c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:23.884913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:23.885841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:23.886662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 172/340] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:23.888033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf951c-b2d4-4687-a5ff-e4f6af9ceb14 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.888033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf951c-b2d4-4687-a5ff-e4f6af9ceb14 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.888033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf951c-b2d4-4687-a5ff-e4f6af9ceb14 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.889491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 173/341] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:23.894628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe431c2-cf5e-451c-9764-af9741183d76 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.894917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe431c2-cf5e-451c-9764-af9741183d76 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.895198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe431c2-cf5e-451c-9764-af9741183d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.895620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d64dc-dfc7-4520-97fa-e7899585646f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:23.914324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-dfe431c2-cf5e-451c-9764-af9741183d76 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:23.915444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-dfe431c2-cf5e-451c-9764-af9741183d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:23.939279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:23.940309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:23.940814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:23.941300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:23.942286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:23.942802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:23.944379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:23.953583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 169/342] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:23.954804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.003719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 174/343] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:24.003719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aee96-94be-4a27-a977-bb909b823b20 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.003719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aee96-94be-4a27-a977-bb909b823b20 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.003719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aee96-94be-4a27-a977-bb909b823b20 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.005869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 175/344] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:24.010873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aee96-94be-4a27-a977-bb909b823b20 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.080979 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0b3d-18ff-4fb0-ade5-2156e0d546ea None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.125503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d26e85-e15f-4964-8582-7e29c18a23f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.126207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d26e85-e15f-4964-8582-7e29c18a23f5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.126490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d26e85-e15f-4964-8582-7e29c18a23f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.126770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d26e85-e15f-4964-8582-7e29c18a23f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.127528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d26e85-e15f-4964-8582-7e29c18a23f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:24.127837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d26e85-e15f-4964-8582-7e29c18a23f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:24.129211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d26e85-e15f-4964-8582-7e29c18a23f5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:24.138136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 170/345] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:24.139367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff713-1896-4462-867e-37fb34b2405d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.139656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff713-1896-4462-867e-37fb34b2405d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.139934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff713-1896-4462-867e-37fb34b2405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.150676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aee96-94be-4a27-a977-bb909b823b20 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.162802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-38aff713-1896-4462-867e-37fb34b2405d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:24.164083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-38aff713-1896-4462-867e-37fb34b2405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:24.189091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.189665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.189977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.190249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.235747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 171/346] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:24.236606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff713-1896-4462-867e-37fb34b2405d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.273816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:24.275445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:24.365964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff713-1896-4462-867e-37fb34b2405d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.395322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 176/347] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:24.396181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.404282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.405084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.405363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.405660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.418834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:24.428763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:24.429886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 11:31:24.430703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:24.431331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 172/348] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:24.431910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.505113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b226-6126-4190-951c-7ac9600d8835 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.544646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.545302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.545803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.546271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.549473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6ce3c-151d-4eab-bcfc-dc10c8b04b05 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.585779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.586853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.587306 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.587730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.599514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:24.608095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:24.609252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:24.610279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:24.612339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 173/349] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:24.613323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.633848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:24.635338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:24.723823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccba57-3346-4a32-8bce-0c3dcea5c454 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.757912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 177/350] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:24.759063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.765087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.766710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.767151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.767586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.769305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:24.770966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:24.772876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 174/351] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:24.773852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.880638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9105eb-5dde-4f35-89ed-264e517922c6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.882680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba4df2-8393-4730-80fe-c42671b292a6 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:24.917952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.919048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.919165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:24.919706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.919827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:24.920083 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:24.920363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.920529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:24.921120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:24.922042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:24.922370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:24.922835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:24.923428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:24.924562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:24.932500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 178/352] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:24.933351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:24.934207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 175/353] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:24.935208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.063472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669bef0-d7fa-417a-954c-208bf9550fea None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.091487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b3bd3-326e-4b97-81cc-ee502579bf7c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.109625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff8427-f711-42de-99a0-d23dcdb8e37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.110989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8427-f711-42de-99a0-d23dcdb8e37b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.111112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8427-f711-42de-99a0-d23dcdb8e37b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.111312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8427-f711-42de-99a0-d23dcdb8e37b None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.122546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff8427-f711-42de-99a0-d23dcdb8e37b None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.124068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff8427-f711-42de-99a0-d23dcdb8e37b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.128641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 176/354] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:25.128641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0ca2-53b6-49f8-9386-7492ece0b6e2 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.128641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0ca2-53b6-49f8-9386-7492ece0b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.128641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0ca2-53b6-49f8-9386-7492ece0b6e2 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.129233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 177/355] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:25.129849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0ca2-53b6-49f8-9386-7492ece0b6e2 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.137937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.139183 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.139462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.139729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.141500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.144719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.145996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 179/356] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:24 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:25.146782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.270237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0ca2-53b6-49f8-9386-7492ece0b6e2 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.280250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7fb65-45e7-47cc-8f95-472d783cf017 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.321648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b927b-18c4-42ef-9c7d-7ecc59be949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.323153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b927b-18c4-42ef-9c7d-7ecc59be949d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.323649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b927b-18c4-42ef-9c7d-7ecc59be949d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.324113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b927b-18c4-42ef-9c7d-7ecc59be949d None admin] PATH_INFO: `/v3/users/6b95fe3c1d314209abf89530dfc75e80` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.324983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.325653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.325978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.326183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b927b-18c4-42ef-9c7d-7ecc59be949d None admin] RBAC: Authorizing `identity:get_user(user_id=6b95fe3c1d314209abf89530dfc75e80)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.326286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.328423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b927b-18c4-42ef-9c7d-7ecc59be949d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.336907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 178/357] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/users/6b95fe3c1d314209abf89530dfc75e80 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:25.336907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3618b-c55c-4138-8244-3315b5d07a28 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.336907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3618b-c55c-4138-8244-3315b5d07a28 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.336907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3618b-c55c-4138-8244-3315b5d07a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.354369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0ff3618b-c55c-4138-8244-3315b5d07a28 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:25.355554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0ff3618b-c55c-4138-8244-3315b5d07a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:25.407478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.408979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.428072 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 179/358] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:25.428752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3618b-c55c-4138-8244-3315b5d07a28 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.513402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 180/359] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:25.514562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.533496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3618b-c55c-4138-8244-3315b5d07a28 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.570870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.571526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.571856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.572539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.573514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=880cb7edf13147c39434b860982f24ba) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:25.573998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.575561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.581352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 180/360] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:25.583608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.634696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834924-f3d8-4a81-be1c-be2f84c0db92 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.678569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.679722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.680230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.680667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.682908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.684392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.686444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 181/361] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:25.687515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.703470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e4ca7-cf62-4c99-a177-d0645262c022 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.739913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ded8-c837-4835-8ac7-3f5d9a878838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.740568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ded8-c837-4835-8ac7-3f5d9a878838 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.740847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ded8-c837-4835-8ac7-3f5d9a878838 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.741117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ded8-c837-4835-8ac7-3f5d9a878838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.741981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ded8-c837-4835-8ac7-3f5d9a878838 None admin] RBAC: Adding query filter params (role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6, user.id=6b95fe3c1d314209abf89530dfc75e80, scope.system=all) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:25.742288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ded8-c837-4835-8ac7-3f5d9a878838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.743719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ded8-c837-4835-8ac7-3f5d9a878838 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.760648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 181/362] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/role_assignments?user.id=6b95fe3c1d314209abf89530dfc75e80&scope.system=all&role.id=7a8626fbf5cd4b0aadd9a8a49fc6c3f6 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:25.762554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db39ca-d9b1-4bc3-aaf6-2f7b7f7c5d50 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.763263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db39ca-d9b1-4bc3-aaf6-2f7b7f7c5d50 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.763739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db39ca-d9b1-4bc3-aaf6-2f7b7f7c5d50 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.766581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 182/363] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:25.770701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db39ca-d9b1-4bc3-aaf6-2f7b7f7c5d50 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.816468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544192-321c-45f9-9f82-a2191fdef6bc None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.890680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.891878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.892387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.892905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.908195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db39ca-d9b1-4bc3-aaf6-2f7b7f7c5d50 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:25.918437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:25.927042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:25.928208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:25.929211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:25.931012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 182/364] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:25.932083 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:25.954044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afa2bc-55d7-475c-a64b-5faff00d572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:25.955285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa2bc-55d7-475c-a64b-5faff00d572b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.955746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa2bc-55d7-475c-a64b-5faff00d572b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.956167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa2bc-55d7-475c-a64b-5faff00d572b None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.957555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afa2bc-55d7-475c-a64b-5faff00d572b None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:25.959271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afa2bc-55d7-475c-a64b-5faff00d572b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:25.966125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 183/365] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:25.967950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de71c8-83b5-49b1-9141-8aa15211c3f9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:25.968914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de71c8-83b5-49b1-9141-8aa15211c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:25.969390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de71c8-83b5-49b1-9141-8aa15211c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:25.992741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-04de71c8-83b5-49b1-9141-8aa15211c3f9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:25.994458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-04de71c8-83b5-49b1-9141-8aa15211c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:26.088011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 184/366] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:26.088011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de71c8-83b5-49b1-9141-8aa15211c3f9 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:26.109756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3463f-6a14-4fce-9903-b9a0cc83a4e9 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:26.160706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:26.162166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:26.162166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:26.162166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:26.162877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:26.163056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:26.165186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:26.172023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 183/367] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:25 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:26.172833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:26.241086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de71c8-83b5-49b1-9141-8aa15211c3f9 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:26.294365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:26.295797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:26.295797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:26.295797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:26.298504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:26.298504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:26.299385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:26.312573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 185/368] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:26.319344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:26.353630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b038ef-c45e-441e-89ba-4b0d1b49d086 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:26.425367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:26.427255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:26.427730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:26.428196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:26.431031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:26.432948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:26.435312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 184/369] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:26.436817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:26.458830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9141d-dcca-4e63-bcb6-e4c3aea43692 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:26.514100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:26.515201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:26.515677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:26.516125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:26.527812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:26.537737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:26.538705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:26.539518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 186/370] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:26.540275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:26.654748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b9cba-e423-4a62-9fae-4232405cfc4c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:26.659571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794832-161d-4c1f-9aca-3439102fda52 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:26.695546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:26.696147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:26.696610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:26.697013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:26.697420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:26.697757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:26.698059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:26.698207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:26.699141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:26.699562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:26.701099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:26.707932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 187/371] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:26.708986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:26.775854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:26.778515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:26.819281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadccb04-b542-4efd-9d61-98f4dc81efe2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:26.910331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:26.911377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:26.911859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:26.912315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:26.913267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:26.913777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:26.915339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:26.930978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 185/372] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:26.932607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 188/373] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:26.939759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:26.940529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:27.120101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82b5e-d5de-48d0-b47b-af2cf552d3ca None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:27.134770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e5696-99d7-4de5-ba27-8876851dd1a2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:27.179969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:27.181044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:27.181474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:27.182107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:27.187915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:27.188940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:27.189235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:27.189501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:27.194126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:27.196079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:27.198780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 186/374] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:27.207834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:27.312490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:27.313999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:27.339091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ef3af-30fc-4e98-a485-aedb6b1b3986 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:27.374779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:27.375880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:27.376310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:27.376740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:27.378098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:27.379697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:27.381808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 187/375] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:27 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:27.387772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:27.475595 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 189/376] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:27.485167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:27.606583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2229-88b1-48f8-80a6-d6594fc4f945 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:27.640020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f5a6f-a8be-4ad7-b29f-2710cf164eaf None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:27.644756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:27.646694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:27.647153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:27.647625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] PATH_INFO: `/v3/projects/11860b8464634d7683ecba74bb161400` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:27.649173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] RBAC: Authorizing `identity:get_project(project_id=11860b8464634d7683ecba74bb161400)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:27.650882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:27.653921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 190/377] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:27 2022] GET /identity/v3/projects/11860b8464634d7683ecba74bb161400 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:27.663821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:27.726962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:27.727889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:27.728314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:27.728731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:27.729745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=880cb7edf13147c39434b860982f24ba) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:27.730261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:27.731873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:27.748018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 188/378] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:27 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 260 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:27.782593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d1c6-6e79-4063-9d3b-385b76ee0bdc None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:27.823530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c731c0-b5c6-4daa-9a8e-70bd8f1f0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:27.824416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c731c0-b5c6-4daa-9a8e-70bd8f1f0814 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:27.824698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c731c0-b5c6-4daa-9a8e-70bd8f1f0814 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:27.824977 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c731c0-b5c6-4daa-9a8e-70bd8f1f0814 None admin] PATH_INFO: `/v3/groups/e9dd3899a25343dcb7e6033c1e0624db` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:27.830753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c731c0-b5c6-4daa-9a8e-70bd8f1f0814 None admin] RBAC: Authorizing `identity:get_group(group_id=e9dd3899a25343dcb7e6033c1e0624db)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:27.832294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c731c0-b5c6-4daa-9a8e-70bd8f1f0814 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:27.834790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 191/379] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:27 2022] GET /identity/v3/groups/e9dd3899a25343dcb7e6033c1e0624db => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:27.843425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:27.969776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271f6e-ae34-4fef-8862-bf6c1b601813 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:28.005509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440d3d-954b-48e5-91ef-c890f45489e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:28.006556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440d3d-954b-48e5-91ef-c890f45489e2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:28.007030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440d3d-954b-48e5-91ef-c890f45489e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:28.007495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440d3d-954b-48e5-91ef-c890f45489e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:28.008516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440d3d-954b-48e5-91ef-c890f45489e2 None admin] RBAC: Adding query filter params (group.id=e9dd3899a25343dcb7e6033c1e0624db, role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=11860b8464634d7683ecba74bb161400) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:28.009033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440d3d-954b-48e5-91ef-c890f45489e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:28.010695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440d3d-954b-48e5-91ef-c890f45489e2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:28.017467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 189/380] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:27 2022] GET /identity/v3/role_assignments?group.id=e9dd3899a25343dcb7e6033c1e0624db&scope.project.id=11860b8464634d7683ecba74bb161400&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:28.390182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264161-d320-4196-88fd-a05c903d5ce2 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:28.390892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264161-d320-4196-88fd-a05c903d5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:28.391379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264161-d320-4196-88fd-a05c903d5ce2 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:28.393260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 192/381] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:28.398329 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d514b-48c6-499d-9a11-ecc7c954f125 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:28.398876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d514b-48c6-499d-9a11-ecc7c954f125 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:28.399343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d514b-48c6-499d-9a11-ecc7c954f125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:28.422794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-748d514b-48c6-499d-9a11-ecc7c954f125 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:28.424358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-748d514b-48c6-499d-9a11-ecc7c954f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:28.509304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 190/382] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:28.538818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07264161-d320-4196-88fd-a05c903d5ce2 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:28.663402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07264161-d320-4196-88fd-a05c903d5ce2 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:28.706967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:28.707762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:28.708044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:28.708320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:28.728765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:28.736578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:28.737448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:28.738297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 193/383] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:28.745462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d514b-48c6-499d-9a11-ecc7c954f125 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:28.871105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d514b-48c6-499d-9a11-ecc7c954f125 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:28.921599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d777c-3bea-427d-b24a-1818427ebabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:28.922236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d777c-3bea-427d-b24a-1818427ebabd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:28.922514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d777c-3bea-427d-b24a-1818427ebabd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:28.922786 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d777c-3bea-427d-b24a-1818427ebabd None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:28.923549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d777c-3bea-427d-b24a-1818427ebabd None admin] RBAC: Adding query filter params (name=member) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:28.923852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d777c-3bea-427d-b24a-1818427ebabd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:28.925238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d777c-3bea-427d-b24a-1818427ebabd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:28.934682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 191/384] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:28.941022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:29.097298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7c291-b99f-4ec6-b23b-fe55da95ab6a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.097955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7c291-b99f-4ec6-b23b-fe55da95ab6a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.098462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7c291-b99f-4ec6-b23b-fe55da95ab6a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.101313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 192/385] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:29.105907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916253-05b3-4c4c-aa62-a69d9ee4fbac None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.106416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916253-05b3-4c4c-aa62-a69d9ee4fbac None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.106920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916253-05b3-4c4c-aa62-a69d9ee4fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.113948 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4415ad-21ce-4170-bc86-ceb7e4fbcc40 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:29.140007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3a916253-05b3-4c4c-aa62-a69d9ee4fbac None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:29.141522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3a916253-05b3-4c4c-aa62-a69d9ee4fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:29.151004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:29.151872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.152151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.152427 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.155843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:29.157293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:29.159957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 194/386] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:28 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:29.166698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:29.268866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 193/387] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:29.307118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916253-05b3-4c4c-aa62-a69d9ee4fbac None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:29.319034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977f73d-1c63-4c07-beda-b603fbb68ef1 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:29.383910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:29.384772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.385055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.385331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.387759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:29.389193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:29.390951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 195/388] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:29 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:29.396752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:29.490273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916253-05b3-4c4c-aa62-a69d9ee4fbac None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:29.568129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e9378-55d1-47f1-b934-c2a2faf034f3 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:29.578958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:29.579760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.580039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.580513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.592075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:29.600846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:29.601924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:29.602867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:29.605565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 194/389] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:29.612514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:29.629157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:29.630422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.630849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.631265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba/groups/c41791b350554ecb99c987e31f2af07b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.635740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] RBAC: Authorizing `identity:create_grant(project_id=880cb7edf13147c39434b860982f24ba, group_id=c41791b350554ecb99c987e31f2af07b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:29.637206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:29.665810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 196/390] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 12 11:31:29 2022] PUT /identity/v3/projects/880cb7edf13147c39434b860982f24ba/groups/c41791b350554ecb99c987e31f2af07b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:29.756137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb4291-f677-4849-b7cb-ffd5f02d3db4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:29.797408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b2fe5-cfe7-4fcc-8167-adb9b117abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:29.798127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b2fe5-cfe7-4fcc-8167-adb9b117abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.798408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b2fe5-cfe7-4fcc-8167-adb9b117abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.798682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b2fe5-cfe7-4fcc-8167-adb9b117abc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.799457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b2fe5-cfe7-4fcc-8167-adb9b117abc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:29.799764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b2fe5-cfe7-4fcc-8167-adb9b117abc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:29.801202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b2fe5-cfe7-4fcc-8167-adb9b117abc5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:29.815637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 195/391] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:29.816657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:29.947939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9cdf-f939-4994-b43c-b7986fc7d3f0 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.948246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9cdf-f939-4994-b43c-b7986fc7d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.948420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9cdf-f939-4994-b43c-b7986fc7d3f0 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.950880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 196/392] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:29.955707 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722fb98-f59e-4bf2-840f-cc530d94c50e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:29.957071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250abd90-ad07-4368-961e-2feb12c6cb04 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.957548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250abd90-ad07-4368-961e-2feb12c6cb04 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.958045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250abd90-ad07-4368-961e-2feb12c6cb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.979360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-250abd90-ad07-4368-961e-2feb12c6cb04 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:29.980865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-250abd90-ad07-4368-961e-2feb12c6cb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:29.991567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:29.992661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:29.992946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:29.993442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:29.995215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:29.997013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:29.999648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 197/393] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:29 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:30.005219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.070499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 197/394] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:30.121270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250abd90-ad07-4368-961e-2feb12c6cb04 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.145618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d2a8a-3357-4b8b-91b9-5553a01d6b3b None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:30.230551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:30.231338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.231618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.231889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.233832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:30.235287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:30.237189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 198/395] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:30 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:30.241490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250abd90-ad07-4368-961e-2feb12c6cb04 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:30.242825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.279640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:30.281744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.282270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.282765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.294890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:30.305106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:30.306071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:30.306881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:30.310214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 198/396] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:30.319460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.426639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82cf93-d25f-40d5-9a55-59ab49d1d9f7 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:30.468170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:30.469390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.469891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.470358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/groups/c41791b350554ecb99c987e31f2af07b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.473181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] RBAC: Authorizing `identity:create_grant(project_id=faae53d1802e4a62b3d4e52d7b2928c3, group_id=c41791b350554ecb99c987e31f2af07b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:30.475025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:30.491410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 199/397] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 12 11:31:30 2022] PUT /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/groups/c41791b350554ecb99c987e31f2af07b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:30.518556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a40cdc-dbc3-42a5-a98f-2a7885e43b92 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:30.577101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc65e-c61b-4d1d-8c1a-08c16c4b3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:30.577809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc65e-c61b-4d1d-8c1a-08c16c4b3600 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.578098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc65e-c61b-4d1d-8c1a-08c16c4b3600 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.578372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc65e-c61b-4d1d-8c1a-08c16c4b3600 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.581292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fc65e-c61b-4d1d-8c1a-08c16c4b3600 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:30.581606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fc65e-c61b-4d1d-8c1a-08c16c4b3600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:30.583140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fc65e-c61b-4d1d-8c1a-08c16c4b3600 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:30.597763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 199/398] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:30.603937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.680411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7365aa2-5a65-4c75-b7e8-04818016d0e1 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.680753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7365aa2-5a65-4c75-b7e8-04818016d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.680953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7365aa2-5a65-4c75-b7e8-04818016d0e1 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.683777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 200/399] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:30.691426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4d772-4fa3-44b6-b609-cec5de391b04 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.692934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4d772-4fa3-44b6-b609-cec5de391b04 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.693477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4d772-4fa3-44b6-b609-cec5de391b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.713744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-fec4d772-4fa3-44b6-b609-cec5de391b04 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:30.715954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fec4d772-4fa3-44b6-b609-cec5de391b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:30.751159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9aaf4-f3ef-48b3-add5-bb8c11832645 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:30.793054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:30.793941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.794233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.794497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.799660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:30.799660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:30.799660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 200/401] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:30 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:30.800028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 201/401] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:30.804768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.819933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4d772-4fa3-44b6-b609-cec5de391b04 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.919892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fee88a-f2b6-4886-a82d-341a87167886 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:30.934851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4d772-4fa3-44b6-b609-cec5de391b04 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:30.955016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ab53c-0b8d-4e72-a1f7-f9fa4f9c2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:30.956206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ab53c-0b8d-4e72-a1f7-f9fa4f9c2c97 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.956701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ab53c-0b8d-4e72-a1f7-f9fa4f9c2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.957182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ab53c-0b8d-4e72-a1f7-f9fa4f9c2c97 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.958634 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ab53c-0b8d-4e72-a1f7-f9fa4f9c2c97 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:30.960303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ab53c-0b8d-4e72-a1f7-f9fa4f9c2c97 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:30.962554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 201/402] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:30 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:30.964073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d535-8587-44bf-ac9e-1633838b6ad4 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.964573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d535-8587-44bf-ac9e-1633838b6ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.965092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d535-8587-44bf-ac9e-1633838b6ad4 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.966816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 202/403] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:30.968942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6d535-8587-44bf-ac9e-1633838b6ad4 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:30.975248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dfd52-bc71-4968-86b0-3e928a6da898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:30.976257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dfd52-bc71-4968-86b0-3e928a6da898 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:30.976704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dfd52-bc71-4968-86b0-3e928a6da898 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:30.977118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dfd52-bc71-4968-86b0-3e928a6da898 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:30.990701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dfd52-bc71-4968-86b0-3e928a6da898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-456dfd52-bc71-4968-86b0-3e928a6da898 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:30.999382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:31.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:31.001261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:31.004017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 202/404] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:31.005444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebee345-759a-42c7-a340-2305b1adf12f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.005954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebee345-759a-42c7-a340-2305b1adf12f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.006428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebee345-759a-42c7-a340-2305b1adf12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.023698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8ebee345-759a-42c7-a340-2305b1adf12f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:31.025213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8ebee345-759a-42c7-a340-2305b1adf12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:31.080319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6d535-8587-44bf-ac9e-1633838b6ad4 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.096760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 203/405] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:31.097900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebee345-759a-42c7-a340-2305b1adf12f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.114649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.115821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.116235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.116666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/groups/c41791b350554ecb99c987e31f2af07b/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.119084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] RBAC: Authorizing `identity:create_grant(project_id=faae53d1802e4a62b3d4e52d7b2928c3, group_id=c41791b350554ecb99c987e31f2af07b, role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:31.120720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:31.140739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 203/406] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 12 11:31:30 2022] PUT /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3/groups/c41791b350554ecb99c987e31f2af07b/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:31:31.141842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.213440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebee345-759a-42c7-a340-2305b1adf12f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.251646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.252574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.253084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.253497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.253747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e0ed9-909e-471e-9350-a7d54dfec85c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.254727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:31.255192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:31.256905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:31.266511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 204/407] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:31.278838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.298131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.298131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.298131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.298131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.306703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:31.316600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:31.317758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:31.318769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 204/408] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:31.326191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.433823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55c98-4be9-47a6-9ae4-82c159dfebd9 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.438121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e98612-7f8d-4983-ab97-2feb4687ab51 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.475961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.476634 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.476920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.477198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.477991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:31.478301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:31.478732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.479789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.479891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:31.480362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.480847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.482257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:31.484486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:31.486691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 205/409] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:31 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:31.489092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 205/410] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:31.493211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.497720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.604856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c54f7b-9467-4b61-8c99-920c66cad3e6 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.643019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.643885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.644217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.644494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] PATH_INFO: `/v3/groups/e9dd3899a25343dcb7e6033c1e0624db` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.645739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] RBAC: Authorizing `identity:get_group(group_id=e9dd3899a25343dcb7e6033c1e0624db)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:31.647493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:31.649817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 206/411] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:31 2022] GET /identity/v3/groups/e9dd3899a25343dcb7e6033c1e0624db => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:31.655968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.756772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b923e-c196-4c3b-bb1a-0e1fe46288e0 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.794654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15566a0a-06d8-4226-a414-aafe262b9037 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:31.798724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.799587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.799868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.800143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.805853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:31.807312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:31.809005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 206/412] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:31 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:31.816035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.863234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:31.864104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:31.864383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:31.864653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] PATH_INFO: `/v3/projects/11860b8464634d7683ecba74bb161400` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:31.868300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] RBAC: Authorizing `identity:get_project(project_id=11860b8464634d7683ecba74bb161400)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:31.869770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:31.874318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 207/413] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:31 2022] GET /identity/v3/projects/11860b8464634d7683ecba74bb161400 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:31.877474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:31.979879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c7f2-dbea-4792-9953-023a05433d2d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:32.041428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41639d64-f32d-4397-bc61-e2784715bba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:32.042245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639d64-f32d-4397-bc61-e2784715bba1 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:32.042527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639d64-f32d-4397-bc61-e2784715bba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:32.042800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639d64-f32d-4397-bc61-e2784715bba1 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba/groups/c41791b350554ecb99c987e31f2af07b/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:32.047521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41639d64-f32d-4397-bc61-e2784715bba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=880cb7edf13147c39434b860982f24ba, group_id=c41791b350554ecb99c987e31f2af07b, role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:32.048970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41639d64-f32d-4397-bc61-e2784715bba1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:32.056134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e10b-ddc4-4016-90d3-bcacf7563b42 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:32.094002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 207/414] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 12 11:31:31 2022] PUT /identity/v3/projects/880cb7edf13147c39434b860982f24ba/groups/c41791b350554ecb99c987e31f2af07b/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:32.107630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7791afe-0100-4d9e-9148-0c502c623f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:32.108546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791afe-0100-4d9e-9148-0c502c623f7a None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:32.108826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791afe-0100-4d9e-9148-0c502c623f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:32.109101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791afe-0100-4d9e-9148-0c502c623f7a None admin] PATH_INFO: `/v3/projects/11860b8464634d7683ecba74bb161400/groups/e9dd3899a25343dcb7e6033c1e0624db/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:32.113552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7791afe-0100-4d9e-9148-0c502c623f7a None admin] RBAC: Authorizing `identity:create_grant(project_id=11860b8464634d7683ecba74bb161400, group_id=e9dd3899a25343dcb7e6033c1e0624db, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:32.115261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7791afe-0100-4d9e-9148-0c502c623f7a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:32.139569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 208/415] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 12 11:31:31 2022] PUT /identity/v3/projects/11860b8464634d7683ecba74bb161400/groups/e9dd3899a25343dcb7e6033c1e0624db/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:31:32.772209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa391-9340-4a76-b78c-b37791451b83 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:32.772550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa391-9340-4a76-b78c-b37791451b83 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:32.772670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa391-9340-4a76-b78c-b37791451b83 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:32.774355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 208/416] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:32.780028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10424f-749f-430a-aa86-bf924734df77 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:32.780478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10424f-749f-430a-aa86-bf924734df77 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:32.780651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10424f-749f-430a-aa86-bf924734df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:32.801358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ca10424f-749f-430a-aa86-bf924734df77 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:32.802564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ca10424f-749f-430a-aa86-bf924734df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:32.880255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 209/417] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:32.922072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fa391-9340-4a76-b78c-b37791451b83 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.054978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fa391-9340-4a76-b78c-b37791451b83 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:33.100975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f92fb7-7295-49b1-8594-e7524bdbaa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:33.101803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f92fb7-7295-49b1-8594-e7524bdbaa75 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.102080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f92fb7-7295-49b1-8594-e7524bdbaa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.102349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f92fb7-7295-49b1-8594-e7524bdbaa75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.118593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f92fb7-7295-49b1-8594-e7524bdbaa75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b4f92fb7-7295-49b1-8594-e7524bdbaa75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:33.126899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:33.131598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:33.133753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 209/418] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:33.135405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10424f-749f-430a-aa86-bf924734df77 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.246412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10424f-749f-430a-aa86-bf924734df77 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:33.280171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0777-2781-4999-9e63-91c3c3f3546b None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.280506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0777-2781-4999-9e63-91c3c3f3546b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.280720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0777-2781-4999-9e63-91c3c3f3546b None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.282396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 210/419] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:33.287016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1c5c-25b3-41e6-9020-9da3e959096d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.287401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1c5c-25b3-41e6-9020-9da3e959096d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.287778 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1c5c-25b3-41e6-9020-9da3e959096d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.288803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:33.289504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.289812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.290083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.290832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] RBAC: Adding query filter params (name=member) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:33.291130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:33.292481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:33.301751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 210/420] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:33.307311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.319132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b32d1c5c-25b3-41e6-9020-9da3e959096d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:33.320348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b32d1c5c-25b3-41e6-9020-9da3e959096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:33.392929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 211/421] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:33.419322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d1c5c-25b3-41e6-9020-9da3e959096d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.474014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07922339-b4a1-4cfc-8a95-7016513e7319 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:33.510245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:33.511336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.511819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.512331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.544484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d1c5c-25b3-41e6-9020-9da3e959096d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:33.579600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:33.580309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.580587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.580856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.584125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:33.585819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:33.597739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:33.598736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:33.599611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:33.600970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 212/422] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:33.610669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.701076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 211/423] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:31:33.706562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.820669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8056407-0275-4767-90da-6a1c39004bb3 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:33.859296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:33.860467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.860944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.861435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.863189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:33.865104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:33.865535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da969f0-2273-4949-9f98-5ca89e15e41e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:33.867738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 212/424] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:33 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:33.872580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.950498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:33.951784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:33.952036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:33.952311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:33.953087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:33.953399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:33.954845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:33.972208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 213/425] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:31:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:33.981913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:33.984833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426147b-8a72-472c-924f-fd509ac917cb None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.026768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80e527-1828-460c-81bb-c6603adbc036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.027623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e527-1828-460c-81bb-c6603adbc036 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.027906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e527-1828-460c-81bb-c6603adbc036 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.028340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e527-1828-460c-81bb-c6603adbc036 None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.033986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80e527-1828-460c-81bb-c6603adbc036 None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:34.035871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80e527-1828-460c-81bb-c6603adbc036 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:34.038604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 213/426] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:33 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:34.039828 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c0ae-256d-4589-9cb1-9e9e8565ed34 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.040108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c0ae-256d-4589-9cb1-9e9e8565ed34 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.040379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c0ae-256d-4589-9cb1-9e9e8565ed34 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.045785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 214/427] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:34.046597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848c0ae-256d-4589-9cb1-9e9e8565ed34 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:34.103148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b43da9-5a35-4b77-8325-cdc75f84ac0e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.139654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.140275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.140563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.140838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.154209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848c0ae-256d-4589-9cb1-9e9e8565ed34 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.192434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a280df-afcd-45df-9456-30327d482541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.193094 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a280df-afcd-45df-9456-30327d482541 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.193376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a280df-afcd-45df-9456-30327d482541 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.193654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a280df-afcd-45df-9456-30327d482541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.194540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a280df-afcd-45df-9456-30327d482541 None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=880cb7edf13147c39434b860982f24ba) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:34.194852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a280df-afcd-45df-9456-30327d482541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:34.196543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a280df-afcd-45df-9456-30327d482541 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:34.209841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 215/428] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:34 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:34.211334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100656f4-4203-427b-9d3d-f1367458cecc None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.211625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100656f4-4203-427b-9d3d-f1367458cecc None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.211902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100656f4-4203-427b-9d3d-f1367458cecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.213196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:34.214972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:34.242883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-100656f4-4203-427b-9d3d-f1367458cecc None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:34.244127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-100656f4-4203-427b-9d3d-f1367458cecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:34.315847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 216/429] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:34.365585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100656f4-4203-427b-9d3d-f1367458cecc None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:34.392558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 214/430] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:31:34.398351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:34.515052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100656f4-4203-427b-9d3d-f1367458cecc None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.542984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf73f-187a-45c5-91ca-de8cc7477708 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.556926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.557810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.558098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.558371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.574001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:34.579814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.580670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.580950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.581223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.582460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:34.582878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:34.584978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:34.587111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:34.589657 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:34.589843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 217/431] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:34.589988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 215/432] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:34 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:34.595350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:34.595594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:34.697015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e790af9-a59e-4604-a720-da834f02bc34 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.697679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5c1af-4624-4f15-8b9e-e7f56f8659e0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.732211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.733214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.733499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.733662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3faf55-62ce-484a-812c-dbc9e9c4aa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.733874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.734303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3faf55-62ce-484a-812c-dbc9e9c4aa12 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.734592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3faf55-62ce-484a-812c-dbc9e9c4aa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.734930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3faf55-62ce-484a-812c-dbc9e9c4aa12 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.735233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:34.735694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3faf55-62ce-484a-812c-dbc9e9c4aa12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:34.736005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3faf55-62ce-484a-812c-dbc9e9c4aa12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:34.736906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:34.737411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3faf55-62ce-484a-812c-dbc9e9c4aa12 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:34.739099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 216/433] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:34 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:34.745832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:34.752208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 218/434] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:34.753594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba56b17-8afe-4f92-8c39-a969f460b0f8 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.753917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba56b17-8afe-4f92-8c39-a969f460b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.754289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba56b17-8afe-4f92-8c39-a969f460b0f8 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.755925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 219/435] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:34.758869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba56b17-8afe-4f92-8c39-a969f460b0f8 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:34.853817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fc1bf-6794-4eaa-bed7-cbaca5689d47 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.869763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba56b17-8afe-4f92-8c39-a969f460b0f8 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:34.888956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503ac2f-a7a0-41bf-9bdd-c5009e4115e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.889612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ac2f-a7a0-41bf-9bdd-c5009e4115e1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.889925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ac2f-a7a0-41bf-9bdd-c5009e4115e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.890206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ac2f-a7a0-41bf-9bdd-c5009e4115e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.891040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ac2f-a7a0-41bf-9bdd-c5009e4115e1 None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=4f6317917e894e6eb35b5ac8f7ca0b64, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:34.891353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ac2f-a7a0-41bf-9bdd-c5009e4115e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:34.892785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ac2f-a7a0-41bf-9bdd-c5009e4115e1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:34.905266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 217/436] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:34 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=4f6317917e894e6eb35b5ac8f7ca0b64 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:34.905266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a3c8-3cab-4580-abc1-61dad0de17e5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.905266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a3c8-3cab-4580-abc1-61dad0de17e5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.905266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a3c8-3cab-4580-abc1-61dad0de17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.913028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:34.913846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:34.914189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:34.914541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:34.928654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0428a3c8-3cab-4580-abc1-61dad0de17e5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:34.930912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0428a3c8-3cab-4580-abc1-61dad0de17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:35.000582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.002110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:35.007445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 218/437] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:35.009392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac684-4bf5-4540-8eae-54551a0c2676 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.009854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac684-4bf5-4540-8eae-54551a0c2676 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.010279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac684-4bf5-4540-8eae-54551a0c2676 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.011791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 219/438] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:35.018371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bc80-cb5a-4b59-aa8b-fbf649544552 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.018662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bc80-cb5a-4b59-aa8b-fbf649544552 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.018931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bc80-cb5a-4b59-aa8b-fbf649544552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.036333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5963bc80-cb5a-4b59-aa8b-fbf649544552 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:35.037548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5963bc80-cb5a-4b59-aa8b-fbf649544552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:35.107082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 220/439] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:35.108020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963bc80-cb5a-4b59-aa8b-fbf649544552 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.120797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 220/440] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:35.126635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.222157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963bc80-cb5a-4b59-aa8b-fbf649544552 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.239019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134efa3-d3c2-4fdc-9b89-2f686a58a04a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.264897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.266008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.266426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.266836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.279191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.280412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.280412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.280579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:35.280652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] PATH_INFO: `/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.281798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] RBAC: Authorizing `identity:get_project(project_id=faae53d1802e4a62b3d4e52d7b2928c3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.283706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:35.285196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 221/441] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/projects/faae53d1802e4a62b3d4e52d7b2928c3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:35.285858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:35.288784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:35.289749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:35.290597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 221/442] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:35.291276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.388011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd15b4-ada9-4ab7-b4ce-59259b5a6b97 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.391220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34793e1-e2e5-4d4d-b799-62367e3e9cbd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.420359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.421150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.421430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.421712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.423131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.423967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.424251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.424526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.425712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.427190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:35.428788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 222/443] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:35.429537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.431550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:35.439497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:35.440412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 222/444] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:35.445956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.528400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55355b-48c5-44ab-83f8-dd60782f5bb5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.536606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486abf7-e470-4892-bb63-52dd0f723984 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.561070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.561747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.562035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.562309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.563053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:35.563361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.564734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:35.568700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.569339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.569621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.569925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.570751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:35.571399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.572773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 223/445] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:35.572920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:35.573362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.580053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 223/446] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=faae53d1802e4a62b3d4e52d7b2928c3&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:35.580830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.678941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4761-e57e-4b53-9059-7f358675a5ab None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.687653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230e90-166b-4852-b15e-bc321040496f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.714726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.715671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.715953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.716224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.717053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:35.717369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.718825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:35.721497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.722187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.722469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.722744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.727665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 224/447] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:35.733559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.795928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.797302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:35.838645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb87a52-a36f-4dcf-8836-729ec277db10 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:35.875434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:35.876325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:35.876428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:35.876677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:35.914821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 224/448] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:35.920837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:35.953382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:35.954991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:36.030598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541510bc-ea89-47e9-82eb-e75925635cfb None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:36.068309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:36.069091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:36.069368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:36.069639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] PATH_INFO: `/v3/projects/880cb7edf13147c39434b860982f24ba` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:36.070622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 225/449] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:31:36.071302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] RBAC: Authorizing `identity:get_project(project_id=880cb7edf13147c39434b860982f24ba)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:36.073076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:36.074679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 225/450] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:35 2022] GET /identity/v3/projects/880cb7edf13147c39434b860982f24ba => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:36.076839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:36.080488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:36.171680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d367-cce4-4a07-9e9a-6a66eaf4afb7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:36.179716 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebe65-fa78-4561-9efd-2769bc3a5a52 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:36.203936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:36.204775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:36.205057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:36.205331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] PATH_INFO: `/v3/projects/11860b8464634d7683ecba74bb161400` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:36.206524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] RBAC: Authorizing `identity:get_project(project_id=11860b8464634d7683ecba74bb161400)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:36.207954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:36.209627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 226/451] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:31:36 2022] GET /identity/v3/projects/11860b8464634d7683ecba74bb161400 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:36.212662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:36.213506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:36.213813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:36.214303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] PATH_INFO: `/v3/groups/c41791b350554ecb99c987e31f2af07b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:36.215076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:36.215243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] RBAC: Authorizing `identity:get_group(group_id=c41791b350554ecb99c987e31f2af07b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:36.217173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:36.218797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 226/452] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:36 2022] GET /identity/v3/groups/c41791b350554ecb99c987e31f2af07b => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:36.224207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:36.316454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba58ab-9f0f-445f-bbfd-ff8423af8e87 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:36.317010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfb61-71ac-4323-99e2-85ef6946c897 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:36.349253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319434a5-3b6e-4ed4-9a91-932a2a1176f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:36.349682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:36.349863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319434a5-3b6e-4ed4-9a91-932a2a1176f1 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:36.350147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319434a5-3b6e-4ed4-9a91-932a2a1176f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:36.350424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319434a5-3b6e-4ed4-9a91-932a2a1176f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:36.350547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:36.350831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:36.351107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] PATH_INFO: `/v3/groups/e9dd3899a25343dcb7e6033c1e0624db` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:36.351256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319434a5-3b6e-4ed4-9a91-932a2a1176f1 None admin] RBAC: Adding query filter params (group.id=c41791b350554ecb99c987e31f2af07b, role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=880cb7edf13147c39434b860982f24ba) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:36.351565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319434a5-3b6e-4ed4-9a91-932a2a1176f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:36.352272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] RBAC: Authorizing `identity:get_group(group_id=e9dd3899a25343dcb7e6033c1e0624db)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:36.353002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319434a5-3b6e-4ed4-9a91-932a2a1176f1 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:36.353685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:36.355315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 227/453] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 12 11:31:36 2022] GET /identity/v3/groups/e9dd3899a25343dcb7e6033c1e0624db => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:36.365176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 227/454] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:36 2022] GET /identity/v3/role_assignments?group.id=c41791b350554ecb99c987e31f2af07b&scope.project.id=880cb7edf13147c39434b860982f24ba&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:36.365383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:36.463725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ef90-ad36-488e-90e5-7d76b67166a6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:36.499800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bca5da-29db-4d7d-855f-dfb79f0271e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:36.500465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca5da-29db-4d7d-855f-dfb79f0271e1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:36.500744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca5da-29db-4d7d-855f-dfb79f0271e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:36.501016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca5da-29db-4d7d-855f-dfb79f0271e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:36.502322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bca5da-29db-4d7d-855f-dfb79f0271e1 None admin] RBAC: Adding query filter params (group.id=e9dd3899a25343dcb7e6033c1e0624db, role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=11860b8464634d7683ecba74bb161400) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:36.502322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bca5da-29db-4d7d-855f-dfb79f0271e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:36.503657 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bca5da-29db-4d7d-855f-dfb79f0271e1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:36.510110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 228/455] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 12 11:31:36 2022] GET /identity/v3/role_assignments?group.id=e9dd3899a25343dcb7e6033c1e0624db&scope.project.id=11860b8464634d7683ecba74bb161400&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:39.249736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a74ce-a0e1-4b3a-b20e-bc9b540d6829 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.249736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a74ce-a0e1-4b3a-b20e-bc9b540d6829 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.249736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a74ce-a0e1-4b3a-b20e-bc9b540d6829 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.251109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 228/456] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:39.256261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991863cc-7555-491f-84cc-b7bda0fbdce0 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.256994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991863cc-7555-491f-84cc-b7bda0fbdce0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.257433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991863cc-7555-491f-84cc-b7bda0fbdce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.275083 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-991863cc-7555-491f-84cc-b7bda0fbdce0 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:39.276664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-991863cc-7555-491f-84cc-b7bda0fbdce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:39.293399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f99589-0339-40b5-8ddf-560684ffe272 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.293924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f99589-0339-40b5-8ddf-560684ffe272 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.294933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f99589-0339-40b5-8ddf-560684ffe272 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.297772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 229/457] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:39.301851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410bae-3600-49c0-98dc-d8aa65231cb4 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.302280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410bae-3600-49c0-98dc-d8aa65231cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.302712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410bae-3600-49c0-98dc-d8aa65231cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.346356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-19410bae-3600-49c0-98dc-d8aa65231cb4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:39.347831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-19410bae-3600-49c0-98dc-d8aa65231cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:39.356283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 229/458] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:39.403031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991863cc-7555-491f-84cc-b7bda0fbdce0 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:39.491406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 230/459] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:39.509726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991863cc-7555-491f-84cc-b7bda0fbdce0 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:39.539034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c7f6-0b60-42d5-9600-18ac2d1f74bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:39.539231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410bae-3600-49c0-98dc-d8aa65231cb4 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:39.539831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c7f6-0b60-42d5-9600-18ac2d1f74bc None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.540114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c7f6-0b60-42d5-9600-18ac2d1f74bc None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.540390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c7f6-0b60-42d5-9600-18ac2d1f74bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.550691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c7f6-0b60-42d5-9600-18ac2d1f74bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:39.552179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c7f6-0b60-42d5-9600-18ac2d1f74bc None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b3b8c7f6-0b60-42d5-9600-18ac2d1f74bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:39.570367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:39.571548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:39.572402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:39.572402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:39.572402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:39.572402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:39.572402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 230/460] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:39.575275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc53b-5847-4560-a3dc-1b3b1d9591f0 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.575275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc53b-5847-4560-a3dc-1b3b1d9591f0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.575275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc53b-5847-4560-a3dc-1b3b1d9591f0 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.575275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 231/461] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:39.578073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc53b-5847-4560-a3dc-1b3b1d9591f0 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:39.653070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410bae-3600-49c0-98dc-d8aa65231cb4 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:39.681870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc53b-5847-4560-a3dc-1b3b1d9591f0 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:39.687939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186876ce-5f17-4db9-9cf6-2e0378d7a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:39.688738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186876ce-5f17-4db9-9cf6-2e0378d7a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.689012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186876ce-5f17-4db9-9cf6-2e0378d7a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.689274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186876ce-5f17-4db9-9cf6-2e0378d7a4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.699932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186876ce-5f17-4db9-9cf6-2e0378d7a4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:39.701611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186876ce-5f17-4db9-9cf6-2e0378d7a4f9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:39.718308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:39.718970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.719250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.719522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.720243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:39.720545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-186876ce-5f17-4db9-9cf6-2e0378d7a4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:39.721180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:39.722183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:39.723173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:39.723173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:39.723173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:39.723173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:39.723388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:39.729460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 231/462] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:39.730956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e83eb-9229-4de8-a29b-d76f0e99db45 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.731376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e83eb-9229-4de8-a29b-d76f0e99db45 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.732354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e83eb-9229-4de8-a29b-d76f0e99db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.744305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 232/463] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:39.744305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:39.751713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6c6e83eb-9229-4de8-a29b-d76f0e99db45 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:39.752991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6c6e83eb-9229-4de8-a29b-d76f0e99db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:39.840822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 232/464] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:39.842618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e83eb-9229-4de8-a29b-d76f0e99db45 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:39.861837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea67f-1fe9-4d85-8df2-dac746038d90 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:39.895283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:39.896176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.896603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.897046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.897936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:39.898424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:39.899959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:39.911810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 233/465] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:39.912808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:39.952677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e83eb-9229-4de8-a29b-d76f0e99db45 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:39.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:39.992824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:39.993193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:39.993532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:39.994322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:39.995987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.020751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 233/466] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:39 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:40.021667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:40.034175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6a696-da02-4252-af80-85a2ce153ce8 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:40.084890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78415360-6be6-4a52-8648-0ec8f94e314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:40.086220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415360-6be6-4a52-8648-0ec8f94e314d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.087084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415360-6be6-4a52-8648-0ec8f94e314d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.087810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415360-6be6-4a52-8648-0ec8f94e314d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.103749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78415360-6be6-4a52-8648-0ec8f94e314d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:40.105670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78415360-6be6-4a52-8648-0ec8f94e314d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-78415360-6be6-4a52-8648-0ec8f94e314d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:40.128653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:40.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:40.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:40.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:40.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:40.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:40.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 234/467] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:40.132102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026912-9502-4917-ae03-f6cb373bc56e None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.132451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026912-9502-4917-ae03-f6cb373bc56e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.132788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026912-9502-4917-ae03-f6cb373bc56e None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.134490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 235/468] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:40.141201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3519-66ce-4234-b9fe-bc931bdc82ef None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.141511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3519-66ce-4234-b9fe-bc931bdc82ef None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.141803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3519-66ce-4234-b9fe-bc931bdc82ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.147138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28dd2d-810e-43f3-9862-98a900a85605 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:40.163390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-da7d3519-66ce-4234-b9fe-bc931bdc82ef None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:40.164815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-da7d3519-66ce-4234-b9fe-bc931bdc82ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:40.188033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:40.189062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.189549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.190055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.191017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:40.192721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.219526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 234/469] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:40 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:40.220777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:40.259396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 236/470] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:40.288302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3519-66ce-4234-b9fe-bc931bdc82ef None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:40.368134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612030c7-20f7-444d-8ac5-c7dc64539244 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:40.410207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3519-66ce-4234-b9fe-bc931bdc82ef None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:40.414836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:40.415722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.416183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.417403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.421892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:40.422400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:40.424365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.440323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 235/471] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:40.446198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:40.457458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:40.458551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.458936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.459340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.470569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:40.472727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:40.493224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:40.494192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:40.495043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:40.495043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:40.495043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:40.495043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:40.495043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 237/472] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:40.501117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:40.565090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef7e80-b27b-4ff6-b721-53caacbc8f80 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:40.606284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:40.607685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.608050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.608428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.609236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:40.610929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.636860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd2ac-a149-4a63-a658-86af16c7bf23 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:40.638841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 236/473] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:40 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:31:40.681956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca100-e602-44a3-aeb3-12053b25f36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:40.682887 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca100-e602-44a3-aeb3-12053b25f36c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.683336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca100-e602-44a3-aeb3-12053b25f36c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.683799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca100-e602-44a3-aeb3-12053b25f36c None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.684740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ca100-e602-44a3-aeb3-12053b25f36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:40.685194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ca100-e602-44a3-aeb3-12053b25f36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:40.686840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ca100-e602-44a3-aeb3-12053b25f36c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.705305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 238/474] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:40.711397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:40.773420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a45b9-3302-4936-90b9-08eabe5182e4 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.773961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a45b9-3302-4936-90b9-08eabe5182e4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.774460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a45b9-3302-4936-90b9-08eabe5182e4 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.777079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 239/475] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:40.782879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4ceb2-6c83-4c16-b548-6f5bf757ca4a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.783163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4ceb2-6c83-4c16-b548-6f5bf757ca4a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.783440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4ceb2-6c83-4c16-b548-6f5bf757ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.814308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-fbb4ceb2-6c83-4c16-b548-6f5bf757ca4a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:40.815565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fbb4ceb2-6c83-4c16-b548-6f5bf757ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:40.888283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2afde-8855-4677-a735-c47baa456596 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:40.927450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:40.928417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:40.928652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 240/476] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:40.929089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:40.929588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:40.930549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:40.932157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:40.952774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4ceb2-6c83-4c16-b548-6f5bf757ca4a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:40.957326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 237/477] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:40 2022] POST /identity/v3/users => generated 249 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:41.068349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4ceb2-6c83-4c16-b548-6f5bf757ca4a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:41.105775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:41.106826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:41.107287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:41.107750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:41.108686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:41.110395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:41.123049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.sql.core [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 11:31:41.123049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 11:31:41.123049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [parameters: {'id': 'e435ef1c28774809be5e1b1f30575817', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 11:31:41.123049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80119) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result = self._query(query) May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application conn.query(q) May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result.read() May 12 11:31:41.139867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return ref.to_dict() May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 11:31:41.140928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application next(self.gen) May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application yield resource May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application next(self.gen) May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.session.rollback() May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.force_reraise() May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise self.value May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application session.commit() May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 11:31:41.143015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._prepare_impl() May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.session.flush() May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._flush(objects) May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application compat.raise_( May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application flush_context.execute() May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rec.execute(self) May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 11:31:41.143952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 11:31:41.144878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result = self._query(query) May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application conn.query(q) May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result.read() May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 11:31:41.146253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [parameters: {'id': 'e435ef1c28774809be5e1b1f30575817', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:41.148370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 11:31:41.150433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:41.152464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 241/478] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 12 11:31:40 2022] POST /identity/v3/roles => generated 144 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:41.152600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:41.252810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ded69-2673-4340-a374-b60233971326 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:41.287063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08248619-d45f-454c-889f-0643e5db70e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:41.287869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248619-d45f-454c-889f-0643e5db70e5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:41.288147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248619-d45f-454c-889f-0643e5db70e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:41.288419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248619-d45f-454c-889f-0643e5db70e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:41.299455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08248619-d45f-454c-889f-0643e5db70e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-08248619-d45f-454c-889f-0643e5db70e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:41.307539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:41.309669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:41.311686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 238/479] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:31:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:41.318639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:41.424218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca2d8-dc88-43ee-91bb-13f775475660 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:41.474942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d6081-a54c-4034-8b74-90f0f846052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:41.475896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6081-a54c-4034-8b74-90f0f846052b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:41.476345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6081-a54c-4034-8b74-90f0f846052b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:41.476787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6081-a54c-4034-8b74-90f0f846052b None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:41.477742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d6081-a54c-4034-8b74-90f0f846052b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:41.478223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d6081-a54c-4034-8b74-90f0f846052b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:41.479853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d6081-a54c-4034-8b74-90f0f846052b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:41.492345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 242/480] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:42.910400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8158f-521b-4b91-a8a0-85adcc0df794 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:42.910881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8158f-521b-4b91-a8a0-85adcc0df794 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:42.910881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8158f-521b-4b91-a8a0-85adcc0df794 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:42.912507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 239/481] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:42.930323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd593-5e72-4f3a-a3e8-558016ad4dfe None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:42.930799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd593-5e72-4f3a-a3e8-558016ad4dfe None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:42.930870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd593-5e72-4f3a-a3e8-558016ad4dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:42.953777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c2ddd593-5e72-4f3a-a3e8-558016ad4dfe None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:42.955071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c2ddd593-5e72-4f3a-a3e8-558016ad4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:43.010460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d328-4de5-43ff-a80b-7d8b90e6edd2 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.011071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d328-4de5-43ff-a80b-7d8b90e6edd2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.011566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d328-4de5-43ff-a80b-7d8b90e6edd2 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.014631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 240/482] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:43.019470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4ee3-042b-41cb-8313-b643369c937b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.019770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4ee3-042b-41cb-8313-b643369c937b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.020051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4ee3-042b-41cb-8313-b643369c937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.040490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0bcc4ee3-042b-41cb-8313-b643369c937b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:43.042827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0bcc4ee3-042b-41cb-8313-b643369c937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:43.069664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 243/483] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:43.105655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddd593-5e72-4f3a-a3e8-558016ad4dfe None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.113299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 241/484] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:43.137462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc4ee3-042b-41cb-8313-b643369c937b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.236554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc4ee3-042b-41cb-8313-b643369c937b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:43.274530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:43.275341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.275626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.275898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.292791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:43.299790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddd593-5e72-4f3a-a3e8-558016ad4dfe None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:43.301081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:43.302030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:43.302845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:43.307422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 242/485] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:43.308792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.370966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:43.372694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.373146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.373586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.383821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:43.391753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:43.392627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:43.393429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:43.396171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 244/486] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:43.401832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.422437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6ddd-447d-4981-91f6-81578bac09d8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:43.461728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:43.461728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.461728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.461728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.462092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:43.462092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:43.462092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:43.474622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 243/487] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:43.475832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.582552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023816bc-9c16-4e82-91fd-0ed03e7d95a9 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:43.617803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff0a1-3408-404f-ae0a-8ce80a8a9315 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:43.626175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555e4aa-8f61-41af-a019-e8cfdefa7caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:43.626937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555e4aa-8f61-41af-a019-e8cfdefa7caf None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.627290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555e4aa-8f61-41af-a019-e8cfdefa7caf None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.627634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555e4aa-8f61-41af-a019-e8cfdefa7caf None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.628960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555e4aa-8f61-41af-a019-e8cfdefa7caf None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:43.629269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555e4aa-8f61-41af-a019-e8cfdefa7caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:43.631214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555e4aa-8f61-41af-a019-e8cfdefa7caf None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:43.654141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 245/488] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:43.655787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65806a5-6df4-4817-9514-638455e5b02b None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.656255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65806a5-6df4-4817-9514-638455e5b02b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.656712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65806a5-6df4-4817-9514-638455e5b02b None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.658190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 246/489] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:43.662551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495975-9fed-4d80-acd1-97a26bf0cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:43.663069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65806a5-6df4-4817-9514-638455e5b02b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.663489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495975-9fed-4d80-acd1-97a26bf0cf57 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.663846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495975-9fed-4d80-acd1-97a26bf0cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.664192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495975-9fed-4d80-acd1-97a26bf0cf57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.676097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495975-9fed-4d80-acd1-97a26bf0cf57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:43.677677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495975-9fed-4d80-acd1-97a26bf0cf57 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-a8495975-9fed-4d80-acd1-97a26bf0cf57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:43.695061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:43.696204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:43.697092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:43.697092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:43.697092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:43.697092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:43.701207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 244/490] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:43.702588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3889-80a5-4f44-a824-d026607227ff None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.702937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3889-80a5-4f44-a824-d026607227ff None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.703308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3889-80a5-4f44-a824-d026607227ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.721124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d74f3889-80a5-4f44-a824-d026607227ff None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:43.722522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d74f3889-80a5-4f44-a824-d026607227ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:43.774326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65806a5-6df4-4817-9514-638455e5b02b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:43.797723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 245/491] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:43.797723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3889-80a5-4f44-a824-d026607227ff None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.831412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:43.832498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.832969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.833392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.845330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:43.847138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:43.872536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:43.873444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:43.879040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:43.879040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:43.879040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:43.879040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:43.879040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 247/492] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:43.879040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.915856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3889-80a5-4f44-a824-d026607227ff None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:43.957410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:43.958474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:43.958947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:43.959409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:43.960419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:43.960946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:43.962529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:43.976136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 246/493] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:43.977352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:43.996465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e93d-178b-4874-815f-f8d1142960af None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.036802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.038025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.038317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.038576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.049550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:44.060000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:44.060907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:44.061735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:44.065594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 248/494] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:44.066565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.088238 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a5aab-e26a-427c-a16f-4b5a71041d1f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.124498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.125569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.126076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.126546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.127488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:44.127996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.129564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.142566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 247/495] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:44.147868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.169581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b7e1-782a-4433-8fdf-09a3b989af09 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.203661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.204448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.204728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.204999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.212223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.213683 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:44.229114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:44.230256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 249/496] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:44.235986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.257694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da661a0-7271-4473-ac26-3cbeee3c2d18 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.292817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa032ec2-4e25-4c4a-bab8-41caeb929468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.293422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa032ec2-4e25-4c4a-bab8-41caeb929468 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.294336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa032ec2-4e25-4c4a-bab8-41caeb929468 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.294617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa032ec2-4e25-4c4a-bab8-41caeb929468 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.295389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa032ec2-4e25-4c4a-bab8-41caeb929468 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:44.295696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa032ec2-4e25-4c4a-bab8-41caeb929468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.297136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa032ec2-4e25-4c4a-bab8-41caeb929468 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.311004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 248/497] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:44.311004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705608-6584-4d93-b159-0334b286a5a4 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.311004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705608-6584-4d93-b159-0334b286a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.311004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705608-6584-4d93-b159-0334b286a5a4 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.311004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 249/498] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:44.311004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705608-6584-4d93-b159-0334b286a5a4 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.346893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f3bf-6807-4c55-8e47-986d1ce78c3d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.380411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.381288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.381567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.381869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.389726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.391177 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:44.404616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:44.405751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:31:44.407094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:44.410406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 250/499] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:44.411222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.413468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705608-6584-4d93-b159-0334b286a5a4 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.446572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d558b-1410-49e4-828f-a370b98d8c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.447236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d558b-1410-49e4-828f-a370b98d8c54 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.447511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d558b-1410-49e4-828f-a370b98d8c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.450952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d558b-1410-49e4-828f-a370b98d8c54 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.450952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d558b-1410-49e4-828f-a370b98d8c54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:44.450952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d558b-1410-49e4-828f-a370b98d8c54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.451256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d558b-1410-49e4-828f-a370b98d8c54 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.487465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 250/500] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:44.488880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a98d8-5bd8-497b-bfb7-e2ce6199e3cf None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.489226 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a98d8-5bd8-497b-bfb7-e2ce6199e3cf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.489569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a98d8-5bd8-497b-bfb7-e2ce6199e3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.506047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-254a98d8-5bd8-497b-bfb7-e2ce6199e3cf None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:44.507223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-254a98d8-5bd8-497b-bfb7-e2ce6199e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:44.508706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3417-704a-4ea1-9368-6501879a3ac7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.540746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.541640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.541952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.542226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.552774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.554198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:44.570628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:44.571602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:44.577610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:44.577610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:44.577610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:44.577610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:44.577610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 251/501] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:44.577610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.581738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 251/502] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:44.581738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375719-03d5-4d15-bfca-e848c71dd3b5 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.581738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375719-03d5-4d15-bfca-e848c71dd3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.581738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375719-03d5-4d15-bfca-e848c71dd3b5 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.586115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 252/503] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:44.586115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375719-03d5-4d15-bfca-e848c71dd3b5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.671984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ca8fb-7ff7-4c58-8a87-5a7492e7aaff None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.677180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375719-03d5-4d15-bfca-e848c71dd3b5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.704079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.704735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.705018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.705292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.706199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:44.706508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.707961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.709220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c7f1c-a62e-42ce-b437-570e95a0db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.709884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c7f1c-a62e-42ce-b437-570e95a0db77 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.710161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c7f1c-a62e-42ce-b437-570e95a0db77 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.710430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c7f1c-a62e-42ce-b437-570e95a0db77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.744216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 252/504] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:44.745045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.774158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c7f1c-a62e-42ce-b437-570e95a0db77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.775637 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c7f1c-a62e-42ce-b437-570e95a0db77 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.840123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a4f5-f5c2-4c20-862c-1eb807dd6867 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:44.871388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 253/505] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:44.872958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:44.873236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcee1f-4a67-4908-b113-fc8e8ccceb93 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.873477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcee1f-4a67-4908-b113-fc8e8ccceb93 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.873636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:44.873836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcee1f-4a67-4908-b113-fc8e8ccceb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.873923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:44.874174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:44.874884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:44.875189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:44.876562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:44.887422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 253/506] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:44.888193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.889040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-39dcee1f-4a67-4908-b113-fc8e8ccceb93 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:44.890227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-39dcee1f-4a67-4908-b113-fc8e8ccceb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:44.951827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 254/507] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:44.952648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcee1f-4a67-4908-b113-fc8e8ccceb93 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:44.982296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb7279-976f-4cb6-b268-55ff81830fcd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.021773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.022906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.023183 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.023451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.033860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:45.041294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:45.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:45.043052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 254/508] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:45.044462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.056317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcee1f-4a67-4908-b113-fc8e8ccceb93 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.089263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.089932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.090256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.090509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.139426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f600a-884a-4ca1-8fb3-62c4c9db9583 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.152607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.154132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.170416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.171195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.171473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.171746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.181634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.183089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:45.200601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:45.201455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:45.202353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:45.202353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:45.202353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.202353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:45.202353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 255/509] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:45.202625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.249994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 255/510] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:45.250808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.297426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1381e-f7bb-4e7c-b0e4-1b546252be67 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.337491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.338427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.338701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.338967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.345459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7547643-aecc-44f7-97ed-7180dbf45c67 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.347520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.349188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:45.365561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:45.366526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:45.367444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 256/511] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:45.368005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.383526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.384309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.384585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.384853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.394503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.395932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:45.412541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:45.413498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:45.414415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:45.414415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:45.414415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.414415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:45.414415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 256/512] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:45.414754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.466131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db597d6-d863-40de-a565-efe023bbf1a7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.498834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.499500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.499795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.500072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.500814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:45.501123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.502534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.508719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c39cb-2c08-4479-aba0-7f4a3c388063 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.510427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 257/513] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:45.511212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.540946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.541592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.541897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.542167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.542875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:45.543175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.544543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.555568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 257/514] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:45.556335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.605601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f2572-122b-48e6-9871-6c5ba2a69654 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.637042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.638396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.638679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.638950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.647149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0d390-bd40-456d-ac9e-e878f1bde4f2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.648978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.650470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:45.667653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:45.668742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:45.670977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:45.670977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:45.670977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.670977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:45.670977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 258/515] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:45.670977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.684045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.684713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.685000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.685268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.686151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:45.686460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.687877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.705369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 258/516] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:45.706188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.765437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9e14f-1a56-4950-ba8f-5776ef0fd3bd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.796494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.797142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.797419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.797690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.798127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6a5dc-0f52-4945-ab96-6191ff65f7ae None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.798440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:45.798747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.800121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.811617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 259/517] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:45.812388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.831229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.832015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.832297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.832573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.842776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.844207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:45.861754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:45.862772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:45.863670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:45.863670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:45.863670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:45.863670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:45.863670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 259/518] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:45.863670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.908132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a36b-78c3-4f95-b19b-d9b3614c4089 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.939520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.940287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.940559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.940830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.947448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.948892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:45.956989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba8a4-2425-4793-bbb4-863a2b61a0ee None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:45.963000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:45.963865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:45.965011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 260/519] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:45.966205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:45.995462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:45.996134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:45.996409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:45.996709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:45.997436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:45.997774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:45.999114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.016089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 260/520] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:46.016922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.064151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e929bd4-8cc1-46ce-9a33-b06c401f3eef None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.095995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.096625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.096902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.097169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.115644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ba62-d4c3-4bd8-b3fd-2b68fd25b2a4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.147606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.148269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.148552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.148828 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.149534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.151005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.161266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.162829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.169770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 261/521] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:31:46 2022] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:31:46.170566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.270871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 261/522] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:46.270871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.277775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a666-02b3-434b-9ec5-6cd7888ff392 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.313980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.314751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.315101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.315443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.316244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:46.316653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.318162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.335531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 262/523] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:46.335531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.371317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b27b-f95e-4f57-8cbe-f2e76e211f78 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.407540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.408302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.408656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.409010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.409904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:46.410217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.411645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.429223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 262/524] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:46.429885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.445141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95c2c8-22b8-44e9-adde-3e21b048ec71 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.480194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.481009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.481289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.481561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.488339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.489801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:46.505314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:46.506207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:46.507077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 263/525] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:46.507981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.532413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3b657-ae50-4fcc-90b2-62917d02cb1c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.565609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.566423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.566727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.566987 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.577783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.579256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:46.596606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:46.597665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:46.598726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:46.598726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:46.598726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:46.598726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:46.604149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 263/526] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:46.604149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.614736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aeebb-56a8-4dda-a022-3a129cbb23f9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.647468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.648236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.648517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.648870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.656763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.658244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:46.673508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:46.674608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 11:31:46.675496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:46.679123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 264/527] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:46.679123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.700606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffd751-b3d0-43bb-9666-d613ca88e0fc None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.734829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.735628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.736001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.736376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.737297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=a7291e3af37548efafd5e4654569677b) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:46.737763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.739276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.754087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 264/528] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/role_assignments?user.id=a7291e3af37548efafd5e4654569677b&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:46.754087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.791236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107884d1-8c52-4fc8-ab03-69c6f1e11465 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.827930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.828719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.829066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.829413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.830342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:46.830718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.832272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.852769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 265/529] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:46.853857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.871378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297e46-204c-4f95-a0be-35f1884889aa None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.908617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.909261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.909543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.909885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.910620 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:46.910923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:46.912320 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:46.930378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 265/530] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:46.930793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:46.960049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7116a2-69e7-45dd-8ea1-dfe72cd1bb0f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:46.995988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:46.997202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:46.997692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:46.998203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:46.999237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:46.999742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:47.001367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:47.019757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 266/531] 10.222.0.58 () {56 vars in 1139 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:47.020899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:47.035863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061fdc3-5b75-4985-a599-2fdfa942c7c4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:47.075522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:47.076299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:47.076526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:47.076703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:47.077526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=59372ef7ca2d439c8a2c12e29f8d97bf) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:47.077863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:47.079587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:47.093857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 266/532] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:46 2022] GET /identity/v3/role_assignments?user.id=59372ef7ca2d439c8a2c12e29f8d97bf&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:47.094897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:47.128925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158ce94-2da7-4eec-9590-a3dc74e5ac7f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:47.164861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:47.166047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:47.166533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:47.167006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:47.175406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:47.177152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:47.191848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:47.192768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:47.193653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:47.196143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 267/533] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:47.202478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:47.275625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a949-4a89-4234-8ae7-d0c13aa93e14 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:47.348751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:47.349404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:47.349681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:47.350278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:47.383876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc19f-5d2f-4142-8c7f-5e438e82e6ab None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:47.443533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:47.444116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:47.444405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:47.444673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:47.445747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:47.446061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:47.455025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:47.458065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:47.459546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:47.478885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 268/534] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:47.485785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:47.613868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dc5a5-7f75-4b4c-a956-bf754717ed5e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:47.651322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:47.652287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:47.657720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:47.657720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:47.657720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=d990142782ed4f2f92e51c2a76693009) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:47.657720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:47.657720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:47.664142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 269/535] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:47 2022] GET /identity/v3/role_assignments?user.id=d990142782ed4f2f92e51c2a76693009&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:47.669239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 267/536] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:47.683579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:47.798384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9823372-f46e-4968-b57b-7975d00aa3da None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:47.836115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:47.836912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:47.837189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:47.837458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:47.853655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:47.855355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:47.874850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:47.875849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:47.876709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:47.876709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:47.876709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:47.876709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:47.876709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 270/537] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:47.882050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:48.027192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715c7e8-8e20-48b6-963a-0ad71b69acbe None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:48.062997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:48.063581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:48.063855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:48.064119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:48.064840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:48.065142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:48.066541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:48.079468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 268/538] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:48.084494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:48.221877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749520-f5a0-4ef9-91f0-3e00e7253529 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:48.261022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:48.261837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:48.262669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:48.262952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:48.272264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:48.273738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:48.292318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:48.293197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:48.294710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 271/539] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:48.302784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:48.442013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f75736-940f-4113-8fb9-a13b2b0cd628 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:48.494647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089030b-1334-4b0a-a3f4-c8a77262bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:48.495344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089030b-1334-4b0a-a3f4-c8a77262bc38 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:48.495632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089030b-1334-4b0a-a3f4-c8a77262bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:48.495907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089030b-1334-4b0a-a3f4-c8a77262bc38 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:48.497301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089030b-1334-4b0a-a3f4-c8a77262bc38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:48.497614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089030b-1334-4b0a-a3f4-c8a77262bc38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:48.499155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089030b-1334-4b0a-a3f4-c8a77262bc38 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:48.512248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 269/540] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:48.517741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:48.710898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565963c-3d50-4850-897f-f16f43ad63a2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:48.746179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89875-956e-49f9-9898-e4966ab4eafb None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:48.746717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89875-956e-49f9-9898-e4966ab4eafb None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:48.747145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89875-956e-49f9-9898-e4966ab4eafb None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:48.748889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 270/541] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:48.755069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c218-6ae2-41e9-a51c-81aa6b06007b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:48.755545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:48.755854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c218-6ae2-41e9-a51c-81aa6b06007b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:48.756194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:48.756472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:48.756747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:48.756952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c218-6ae2-41e9-a51c-81aa6b06007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:48.757574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=9c1c4e1fe220486ab672b3dea6ffdfec) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:48.757901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:48.759480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:48.769269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 272/542] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:48 2022] GET /identity/v3/role_assignments?user.id=9c1c4e1fe220486ab672b3dea6ffdfec&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:48.794841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f4c7c218-6ae2-41e9-a51c-81aa6b06007b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:48.796508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f4c7c218-6ae2-41e9-a51c-81aa6b06007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:48.908388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 271/543] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:48.956353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.068606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ae3ae-ee69-4a9f-b518-545507ef507d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.109616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:49.110448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.110769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.111045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.121362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:49.129586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:49.130495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:49.131316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 273/544] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:49.138239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c218-6ae2-41e9-a51c-81aa6b06007b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.240210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c218-6ae2-41e9-a51c-81aa6b06007b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.281273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99fc2-6361-4c85-9ab3-05e53e811519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:49.282022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99fc2-6361-4c85-9ab3-05e53e811519 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.282302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99fc2-6361-4c85-9ab3-05e53e811519 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.282578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99fc2-6361-4c85-9ab3-05e53e811519 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.283332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99fc2-6361-4c85-9ab3-05e53e811519 None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:49.283636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99fc2-6361-4c85-9ab3-05e53e811519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:49.285017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99fc2-6361-4c85-9ab3-05e53e811519 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:49.294529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 272/545] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:49.299912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.342575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eca62-d339-4bd7-af88-9b0b8cf514e9 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.342575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eca62-d339-4bd7-af88-9b0b8cf514e9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.343014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eca62-d339-4bd7-af88-9b0b8cf514e9 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.344457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 273/546] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:49.349770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514814-af60-4b03-b218-efc4ad5e5d52 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.350124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514814-af60-4b03-b218-efc4ad5e5d52 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.350409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514814-af60-4b03-b218-efc4ad5e5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.387973 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f1514814-af60-4b03-b218-efc4ad5e5d52 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:49.388977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f1514814-af60-4b03-b218-efc4ad5e5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:49.418915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e24751-0b0b-4fa0-8195-ca7ff1150099 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.454652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:49.455823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.456311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.456786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.468514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:49.474946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:49.477283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 274/547] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:49.504873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1514814-af60-4b03-b218-efc4ad5e5d52 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:49.505410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:49.506441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:49.507294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:49.507294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:49.507294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:49.507294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:49.507294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 274/548] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:49.512808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.606858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1514814-af60-4b03-b218-efc4ad5e5d52 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.646186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:49.647402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.647883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.648351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.653527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048f996-31f1-49cd-a59c-eb38635e0fbf None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.660032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:49.668059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:49.669044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:49.670262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:49.672651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 275/549] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:49.678388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.688483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:49.688984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.689265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.689542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.690313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:49.690621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:49.691993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:49.709986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 275/550] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:49.711334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.791677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a006c4-e9c7-4e60-9dc0-cfb13f198373 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.827693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:49.829172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.829878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.830598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.831881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:49.832413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:49.834089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:49.843776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 276/551] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:49.849465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:49.912027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2519f2-44d0-4a31-962f-b9337f115f6e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.946837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f99faf-c3c7-496b-9aa9-8c54bfc374f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:49.947618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f99faf-c3c7-496b-9aa9-8c54bfc374f2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.947903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f99faf-c3c7-496b-9aa9-8c54bfc374f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.948177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f99faf-c3c7-496b-9aa9-8c54bfc374f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.957461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f99faf-c3c7-496b-9aa9-8c54bfc374f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:49.959519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f99faf-c3c7-496b-9aa9-8c54bfc374f2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:49.961621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2668bea-216c-42eb-9fc5-fc22331feef8 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-e1f99faf-c3c7-496b-9aa9-8c54bfc374f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:49.977607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:49.978541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 11:31:49.979424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:49.981778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 276/552] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:49.983233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5b73-4d16-4362-9ee0-2d368b9f78e5 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:49.983732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5b73-4d16-4362-9ee0-2d368b9f78e5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:49.984930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5b73-4d16-4362-9ee0-2d368b9f78e5 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:49.986505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 277/553] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:49.987197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a5b73-4d16-4362-9ee0-2d368b9f78e5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.003687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90717d97-ccc1-464d-b0dd-2f01a6dbf6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.004887 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90717d97-ccc1-464d-b0dd-2f01a6dbf6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.005416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90717d97-ccc1-464d-b0dd-2f01a6dbf6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.005968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90717d97-ccc1-464d-b0dd-2f01a6dbf6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.017585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90717d97-ccc1-464d-b0dd-2f01a6dbf6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.019386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90717d97-ccc1-464d-b0dd-2f01a6dbf6a6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-90717d97-ccc1-464d-b0dd-2f01a6dbf6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:50.038482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:50.039393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:50.040252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:50.040252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:50.040252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:50.040252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:50.042494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 277/554] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:50.044504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dbee8-6373-43c6-a1be-af2ee87be1c7 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.045058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dbee8-6373-43c6-a1be-af2ee87be1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.045535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dbee8-6373-43c6-a1be-af2ee87be1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.063095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f49dbee8-6373-43c6-a1be-af2ee87be1c7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:50.064591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f49dbee8-6373-43c6-a1be-af2ee87be1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:50.102181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a5b73-4d16-4362-9ee0-2d368b9f78e5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.134062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 278/555] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:50.135335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dbee8-6373-43c6-a1be-af2ee87be1c7 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.160825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.162884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.163807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.164705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.166557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:50.166878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.168839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.191163 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 278/556] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 12 11:31:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:50.198188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.274241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dbee8-6373-43c6-a1be-af2ee87be1c7 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.305529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b963cb-b182-4263-85da-675a5dfdd75e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.322264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.323191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.323746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.324158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.326260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:50.326713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.328859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.345564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 279/557] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:50.346647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.347660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.348707 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.349100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.349546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.365247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:50.373548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:50.374672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:50.375743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:50.377741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 279/558] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:50.378615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.476482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1583-65b7-4b0c-8c4d-3f06dd04196a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.493822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf096-022e-4359-ba31-d8940c3847d2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.509601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.510381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.510783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.511171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.535118 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.536065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.536352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.536623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.547396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.548877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:50.568952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:50.571153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 280/559] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:50.573029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.586499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.588354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.694030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c8a2c-a51c-4e32-975b-6d22f5c24546 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.710347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 280/560] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:50.711458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.733988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.734692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.735040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.735468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.736288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:50.736694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.738160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.747535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 281/561] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:50.748440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.826512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1ad40-9bca-4b36-bbd8-9d7d46b9f854 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.853766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe0328-48a9-4cd8-b832-eb6660f06492 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:50.860194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b7b31-f298-4df4-8e00-805bc78da314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.860860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b7b31-f298-4df4-8e00-805bc78da314 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.861137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b7b31-f298-4df4-8e00-805bc78da314 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.861406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b7b31-f298-4df4-8e00-805bc78da314 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.862265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b7b31-f298-4df4-8e00-805bc78da314 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:50.862577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b7b31-f298-4df4-8e00-805bc78da314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.864001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b7b31-f298-4df4-8e00-805bc78da314 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.881466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 281/562] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:50.882783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de286e-02b5-49bf-a9e7-565b4164cbf8 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.883073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de286e-02b5-49bf-a9e7-565b4164cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.883386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de286e-02b5-49bf-a9e7-565b4164cbf8 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.884962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 282/563] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:50.885968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de286e-02b5-49bf-a9e7-565b4164cbf8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.896154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:50.896947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:50.897221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:50.897487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:50.908455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:50.909915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:50.926292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:50.927359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:50.928228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:50.928228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:50.928228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:50.928228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:50.928228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 282/564] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:50.928228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:50.989033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de286e-02b5-49bf-a9e7-565b4164cbf8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.022689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d839d-71c0-4b4d-820b-ab2d8b1a6423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.023473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d839d-71c0-4b4d-820b-ab2d8b1a6423 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.023755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d839d-71c0-4b4d-820b-ab2d8b1a6423 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.024029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d839d-71c0-4b4d-820b-ab2d8b1a6423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.033312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547073c5-039b-4ced-833b-046c14bd581f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.033670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d839d-71c0-4b4d-820b-ab2d8b1a6423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.035251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d839d-71c0-4b4d-820b-ab2d8b1a6423 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b10d839d-71c0-4b4d-820b-ab2d8b1a6423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:51.052789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:51.053741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:51.054817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:51.054817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:51.054817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:51.054817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:51.054817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 283/565] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:51.055966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ddae6-86bb-455f-8a0f-d3f0897e744e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.056247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ddae6-86bb-455f-8a0f-d3f0897e744e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.056517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ddae6-86bb-455f-8a0f-d3f0897e744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.073071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-374ddae6-86bb-455f-8a0f-d3f0897e744e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:51.073465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.074878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.074980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-374ddae6-86bb-455f-8a0f-d3f0897e744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:51.075288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.075559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.088914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.091171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:51.110000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:51.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:51.111880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:51.111880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:51.111880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:51.111880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:51.111880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 283/566] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:51.112152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.148020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 284/567] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:51.148689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ddae6-86bb-455f-8a0f-d3f0897e744e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.230457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1144-a79c-4a14-ace5-64bc771f1d82 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.246006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ddae6-86bb-455f-8a0f-d3f0897e744e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.262389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.263038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.263314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.263584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.264294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:51.264594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.265965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.277880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 284/568] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:51.278710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.282900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.283561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.283840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.284112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.284837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:51.285142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.286545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.298090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 285/569] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:51.298863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.374100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004378d-6f57-4768-9e5b-23f7b267be47 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.391810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d12fb-f3c6-48ca-8e32-bde1809256a8 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.406083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a800a-cbd1-4671-9703-784df73745bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.406735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a800a-cbd1-4671-9703-784df73745bf None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.407013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a800a-cbd1-4671-9703-784df73745bf None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.407285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a800a-cbd1-4671-9703-784df73745bf None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.407999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a800a-cbd1-4671-9703-784df73745bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:51.408302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a800a-cbd1-4671-9703-784df73745bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.409659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a800a-cbd1-4671-9703-784df73745bf None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.420773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 285/570] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:51.421986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43277329-0527-491d-874c-0ac07d71d5a2 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.422274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43277329-0527-491d-874c-0ac07d71d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.422547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43277329-0527-491d-874c-0ac07d71d5a2 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.423750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 286/571] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:51.424433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43277329-0527-491d-874c-0ac07d71d5a2 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.428385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.429165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.429439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.429733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.440099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:51.448004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:51.448918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 286/572] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:51.450684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.525123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43277329-0527-491d-874c-0ac07d71d5a2 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.543924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2258ba-4261-4c4f-b4f6-37c2c2bf7f9b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.556283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.557064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.557342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.557612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.564740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.566200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.576346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843777ae-53ea-4b72-8d61-04b270cbda05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.577111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843777ae-53ea-4b72-8d61-04b270cbda05 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.577390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843777ae-53ea-4b72-8d61-04b270cbda05 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.577659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843777ae-53ea-4b72-8d61-04b270cbda05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:51.580167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:51.581146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 287/573] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:51.587083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.587759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843777ae-53ea-4b72-8d61-04b270cbda05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.587759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843777ae-53ea-4b72-8d61-04b270cbda05 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-843777ae-53ea-4b72-8d61-04b270cbda05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:51.600405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:51.602098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 287/574] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c267761-c515-4b16-be58-f52d76ad5b8f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.603289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c267761-c515-4b16-be58-f52d76ad5b8f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.604150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c267761-c515-4b16-be58-f52d76ad5b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.620072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0c267761-c515-4b16-be58-f52d76ad5b8f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:51.621855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0c267761-c515-4b16-be58-f52d76ad5b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:51.677459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8a949-6495-47d0-96b4-753ec20f9317 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.683050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 288/575] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:51.684454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c267761-c515-4b16-be58-f52d76ad5b8f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.710334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.711115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.711395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.711669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.718680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.720103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:51.733986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:51.734936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:51.735818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 288/576] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:51.736317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.783516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c267761-c515-4b16-be58-f52d76ad5b8f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.814736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.815384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.815660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.815932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.816662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:51.816964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.818353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.826628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 289/577] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:51.827386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.828898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66212cb-5c9c-4fc2-bacb-b4d4e8f0fc86 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.862651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.863305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.863589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.863865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.864648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:51.864956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.866412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.878451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 289/578] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:51.879224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:51.921755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d97527-c7c3-4c27-915d-82aaac92892d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.953865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:51.954520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:51.954800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:51.955071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:51.955904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:51.956207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:51.957639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:51.973025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08466-b84d-4c19-8056-6ef409969bd4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:51.974953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 290/579] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:51.975813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.005119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.005922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.006198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.006463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.015938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:52.023480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:52.024395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:52.025250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 290/580] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:52.025985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.072491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd6e43-89ea-4c14-85c6-fc7c2339c275 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.104627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.105270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.105549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.105855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.106633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:52.106935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.108349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.119154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 291/581] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:52.119925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.120609 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff33c2-18fe-44ee-9b72-94eb5a6d61a4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.153247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.154064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.154347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.154645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.164780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.166260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:52.182617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:52.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:52.184480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:52.184480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:52.184480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:52.184480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:52.184480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 291/582] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:52.184765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.212943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc52e-9ebe-487e-b21e-0b33231237a1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.244496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.245207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.245550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.245913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.246791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=6754ef93d9344beeae2a5f2812746025) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:52.247095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.248503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.253754 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 292/583] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/role_assignments?user.id=6754ef93d9344beeae2a5f2812746025&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:52.254511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.282383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0423d74-09c0-4539-bc0f-e1c54014c083 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.320213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.321088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.321373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.321644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.333805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.335322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:52.354851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:52.356373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:52.357800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:52.357800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:52.357800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:52.357800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:52.358396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bdb56-62ac-4819-818f-3bdb3009868f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.358820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 292/584] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:52.358820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.396592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.397276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.397561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.397872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.398630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:52.398937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.400322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.414096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 293/585] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:52.414880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.463086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d7984-e0da-49cb-bba5-41664c6d76e0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.495747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.496666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.497374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.497642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/a7291e3af37548efafd5e4654569677b/roles/29b66fdb14844ff6b20ff938a256fd87` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.512115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=a7291e3af37548efafd5e4654569677b, role_id=29b66fdb14844ff6b20ff938a256fd87)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.514070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.526349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0cef-05eb-414a-a0ac-d2364f34995a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.537740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 293/586] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:52 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/a7291e3af37548efafd5e4654569677b/roles/29b66fdb14844ff6b20ff938a256fd87 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:52.537740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.574702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.575548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.575899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.576244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.577078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:52.577458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.578976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.594288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 294/587] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:52.595266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.654585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca63489-8e83-4290-a925-3792001ad75b None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.690872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.691714 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.692089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.692482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.693322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:52.693756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.695584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.705994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c07a2-5280-4e7b-aede-cc255bfb721f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.713074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 294/588] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:52.714220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.751387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.752189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.752469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.752739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.765311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.766853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:52.786020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:52.787118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:52.788207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:52.788207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:52.788207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:52.788207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:52.789751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 295/589] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:52.790678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.866830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2a4e6-f1b1-4f65-b6b1-528087bf9cb4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.903723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.904518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.904801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.905076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.909688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e00c8-fcca-4a01-adcf-80fd1b1b23b5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:52.913563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.915047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:52.929396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:52.930407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:52.931356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 295/590] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:52.931961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:52.948828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:52.950201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:52.950476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:52.950800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:52.957912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:52.959473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:52.974063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:52.976113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 296/591] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:52.978392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.034233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76230dd1-c32e-4eb4-94e3-8fb609f8afb3 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.068740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.069405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.069687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.070291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.071020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:53.071326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.072685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.079223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fbe9f-7b6c-423e-a89e-3a7c9230e674 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.089390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 296/592] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:53.090380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.118889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.119511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.119825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.120107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.120962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:53.121890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.123302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.140920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 297/593] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 12 11:31:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:53.141328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.190459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3818fb-62d8-42d6-9730-30f38e7e7711 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.224350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.225007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.225290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.225563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.226387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:53.226696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.228113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.245358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 297/594] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:53.245358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.281335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0044d8-fbde-4019-981c-f1603312ac02 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.324368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.325945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.326766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.327384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.336713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.338840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.348965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f24a6-dccc-48c6-a128-0be3f448e5b0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:53.359375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:53.360581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 11:31:53.361570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:53.364226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 298/595] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:53.365292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.390936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.392009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.392443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.393465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.408835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.410518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:53.433389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:53.434527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:53.435615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:53.435615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:53.435615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:53.435615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:53.442393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 298/596] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:53.443924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.484174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44870f7-c461-43dc-be5a-7ef8f72d4f34 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.524429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.525448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.525867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.526268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/59372ef7ca2d439c8a2c12e29f8d97bf/roles/29b66fdb14844ff6b20ff938a256fd87` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.541091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=59372ef7ca2d439c8a2c12e29f8d97bf, role_id=29b66fdb14844ff6b20ff938a256fd87)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.542699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.568676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 299/597] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:53 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/59372ef7ca2d439c8a2c12e29f8d97bf/roles/29b66fdb14844ff6b20ff938a256fd87 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:53.576137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.579491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb65e-0d4f-4a13-99f5-6ffeba758dff None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.657343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.658050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.658386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.658710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.659577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:53.659886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.661353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.701643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 299/598] 10.222.0.58 () {56 vars in 1139 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:53.706874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.738340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ad61f-0aee-456d-a7f7-3776b2e26c86 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.775289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.775962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.776251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.776526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.777297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:53.777608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.779020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.790925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 300/599] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:53.797019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:53.897845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1af6b-c78e-41a4-8c54-fb767b978810 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.915824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb814db9-e50f-41a6-86c6-4e0e96963eec None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:53.954504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.955536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.955823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.956102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.963981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:53.966337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:53.979273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:53.980454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:53.980938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:53.981417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:53.981806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:53.982684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:53.983587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 301/600] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:53.988914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:54.006349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:54.007807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:54.041266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:54.042281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:54.043217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:54.043217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:54.043217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:54.043217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:54.043217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 300/601] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:54.049724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:54.205491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41b378-6e06-4c84-9689-5d6a635efb0c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:54.207367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffc16d-d541-40be-b6c2-cef2c286bfde None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:54.267320 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:54.268761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:54.269638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:54.270496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:54.270960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:54.271414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:54.271888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:54.272858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:54.273313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:54.274517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:54.275418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:54.276028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:54.278199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:54.279259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:54.300651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 302/602] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:54.301091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 301/603] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:54.306780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:54.306950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:54.477391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad195a-fc88-4dde-ad68-56f74d5f2ca2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:54.522760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:54.523947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:54.524475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:54.524962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:54.527639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeae91b-7f5f-4efe-bce8-47f071baedf8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:54.533919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:54.535669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:54.552800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:54.553832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:54.554803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:54.555724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 303/604] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:54.563240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:54.598766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3369ed-ad22-491e-906c-0b672694afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:54.599664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3369ed-ad22-491e-906c-0b672694afbf None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:54.599943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3369ed-ad22-491e-906c-0b672694afbf None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:54.600220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3369ed-ad22-491e-906c-0b672694afbf None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/d990142782ed4f2f92e51c2a76693009/roles/29b66fdb14844ff6b20ff938a256fd87` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:54.619274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3369ed-ad22-491e-906c-0b672694afbf None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=d990142782ed4f2f92e51c2a76693009, role_id=29b66fdb14844ff6b20ff938a256fd87)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:54.620724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3369ed-ad22-491e-906c-0b672694afbf None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:54.638216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 302/605] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:54 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/d990142782ed4f2f92e51c2a76693009/roles/29b66fdb14844ff6b20ff938a256fd87 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:54.639657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7310-cdd1-4888-aabe-c0acc0f5431c None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:54.639944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7310-cdd1-4888-aabe-c0acc0f5431c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:54.640237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7310-cdd1-4888-aabe-c0acc0f5431c None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:54.649748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 303/606] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:54.653739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbaabc-7e6d-4d14-b8b2-1d857b1a252c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:54.653739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbaabc-7e6d-4d14-b8b2-1d857b1a252c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:54.653739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbaabc-7e6d-4d14-b8b2-1d857b1a252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:54.690540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d3cbaabc-7e6d-4d14-b8b2-1d857b1a252c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:54.693136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d3cbaabc-7e6d-4d14-b8b2-1d857b1a252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:54.766083 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f8ec-b7e4-48df-a53d-031893fc6081 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:54.807879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:54.809066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 304/607] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:54.813834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:54.814420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:54.814914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:54.816012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:54.816536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:54.818254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:54.838824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 304/608] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:54.844219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbaabc-7e6d-4d14-b8b2-1d857b1a252c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:54.845193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:54.967123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbaabc-7e6d-4d14-b8b2-1d857b1a252c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:54.971649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dabe1b-ad1b-40f9-b5ed-f53741fc7495 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:55.006473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.007718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.008304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.008795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/9c1c4e1fe220486ab672b3dea6ffdfec/roles/29b66fdb14844ff6b20ff938a256fd87` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.019507 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3759a7-2ef1-4cb6-b4eb-6a3db9e89469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.020301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3759a7-2ef1-4cb6-b4eb-6a3db9e89469 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.020586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3759a7-2ef1-4cb6-b4eb-6a3db9e89469 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.020864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3759a7-2ef1-4cb6-b4eb-6a3db9e89469 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.027632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=9c1c4e1fe220486ab672b3dea6ffdfec, role_id=29b66fdb14844ff6b20ff938a256fd87)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:55.029357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:55.043883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3759a7-2ef1-4cb6-b4eb-6a3db9e89469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:55.044288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 305/609] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:54 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/9c1c4e1fe220486ab672b3dea6ffdfec/roles/29b66fdb14844ff6b20ff938a256fd87 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-9d3759a7-2ef1-4cb6-b4eb-6a3db9e89469 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:55.051970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:55.053072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:55.054053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:55.057635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 305/610] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:55.065963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:55.092287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e961d-19c5-4960-8041-6edc1fffab65 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.093644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e961d-19c5-4960-8041-6edc1fffab65 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.094217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e961d-19c5-4960-8041-6edc1fffab65 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.096517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 306/611] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:31:55.106000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1732-c59a-4018-8d62-1ab46381dd7c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.106642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1732-c59a-4018-8d62-1ab46381dd7c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.107159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1732-c59a-4018-8d62-1ab46381dd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.145113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a28f1732-c59a-4018-8d62-1ab46381dd7c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:55.149242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a28f1732-c59a-4018-8d62-1ab46381dd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:55.242891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b30cd-cfed-48db-9df0-b4cfea4abe79 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:55.268310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 307/612] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:31:55.286672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.287256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.287526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.287791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.288535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:55.288892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:55.290359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:55.296573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1732-c59a-4018-8d62-1ab46381dd7c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:55.302975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 306/613] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:55.312000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:55.430694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1732-c59a-4018-8d62-1ab46381dd7c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:55.488357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b9c52-e6de-48cc-bd3d-6a7c6a838805 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:55.522977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.523786 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.524061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.524331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.537161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.538615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.539316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.540911 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.552293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:55.563589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:55.563765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:55.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:55.565516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 308/614] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:55.568379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:55.573659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:55.613725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:55.614737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:55.615674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:55.615674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:55.615674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:55.615674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:55.617791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 307/615] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:55.622580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:55.745560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac58a-73f1-4c49-9f26-a5311c687b0f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:55.760302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062dc52-69c8-4e6b-b783-479538717bf5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:55.795037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.796046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.796534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.797013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.798069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:55.798679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:55.800394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:55.802399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.803377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.803377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.803585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.804339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:55.804703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:55.806142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:55.814671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 308/616] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:55.822654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:55.823946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 309/617] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:55.829579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:55.925548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e2db1-f248-4b4e-b65c-bcd40165221c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:55.964509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:55.965730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:55.966236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:55.966716 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:55.974553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:55.976264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:55.992048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:55.993049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 11:31:55.994062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:55.997245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 309/618] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:31:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:56.009355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.064611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7a59a-3321-4f75-98ae-d1db756f078f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.114349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e2ee-d7b0-44be-83e7-0ced87501a93 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.127803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba0fc-718c-4745-b9b2-e0be6c942605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.128612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba0fc-718c-4745-b9b2-e0be6c942605 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.128922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba0fc-718c-4745-b9b2-e0be6c942605 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.129150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba0fc-718c-4745-b9b2-e0be6c942605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.146166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba0fc-718c-4745-b9b2-e0be6c942605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.147898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba0fc-718c-4745-b9b2-e0be6c942605 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.155168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23778b63-443d-461e-aaa0-0c9c4189ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.156472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778b63-443d-461e-aaa0-0c9c4189ab58 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.156958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778b63-443d-461e-aaa0-0c9c4189ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.157823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778b63-443d-461e-aaa0-0c9c4189ab58 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.159160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23778b63-443d-461e-aaa0-0c9c4189ab58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:56.159661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23778b63-443d-461e-aaa0-0c9c4189ab58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.161275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23778b63-443d-461e-aaa0-0c9c4189ab58 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a08ba0fc-718c-4745-b9b2-e0be6c942605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:56.167674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:56.168621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:56.169521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:56.169521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:56.169521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:56.169521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:56.169521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 310/619] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:31:56.171197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b0b76-1109-4f46-a591-fb0124b84993 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.171575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b0b76-1109-4f46-a591-fb0124b84993 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.171942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b0b76-1109-4f46-a591-fb0124b84993 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.174974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 311/620] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:56.175826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b0b76-1109-4f46-a591-fb0124b84993 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.184376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 310/621] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:31:56.185890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abdd1-5e21-4731-873d-6ba28af4f7a9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.186350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abdd1-5e21-4731-873d-6ba28af4f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.186767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abdd1-5e21-4731-873d-6ba28af4f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.207052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-963abdd1-5e21-4731-873d-6ba28af4f7a9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:56.208802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-963abdd1-5e21-4731-873d-6ba28af4f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:56.289266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 311/622] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:56.290397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963abdd1-5e21-4731-873d-6ba28af4f7a9 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.294867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b0b76-1109-4f46-a591-fb0124b84993 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.330440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.331331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.331893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.332400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.333370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:56.333909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.335476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.347955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 312/623] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:56.349082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.387984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963abdd1-5e21-4731-873d-6ba28af4f7a9 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.422283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.422619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.422837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.423107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.433006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.434494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:56.452216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:56.453196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:56.454152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:56.454152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:56.454152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:56.454152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:56.457881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 312/624] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:56.458919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.463489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8902a40-1994-4bbc-a753-d696c0ba344b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.505104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.506255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.506744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.507219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.518290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:56.526434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:56.528373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:56.529222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:56.532009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 313/625] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:56.533040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.559952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116d15d-e261-44ba-82d3-fdd298058c0a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.593886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.594612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.594872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.595143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.602480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.603914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:56.619047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:56.620037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:56.621572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 313/626] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:56.622230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.643767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aae7b5-2107-4ed3-8567-bf96e818c912 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.678481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.679515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.680010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.680550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.681503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:56.682063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.684280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.697115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 314/627] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:56.698263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.724516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5b1a-8fd8-435c-9c67-5bb8d7106e2c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.760142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.760803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.761080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.761375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.762164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:56.762465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.763816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.772320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 314/628] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:56.773005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.802995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898df8ff-fca7-44c8-a09f-9868536a4de1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.838295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.839347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.839865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.840346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.841413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:56.841971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.843596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.862274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 315/629] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:56.863395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.871482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbd227-757c-41fc-a19a-d79eff2a483d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:56.905901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:56.906690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:56.906966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:56.907237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:56.914284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:56.915850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:56.929854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:56.930967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 315/630] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:56.931878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:56.974008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c2e7-846f-43b1-a243-7a7127b1348f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.009950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.010979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.012032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.012492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.023139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.024919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.035961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e82ca4-81e1-48b2-80b8-f2c7c7334259 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:57.043243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:57.044263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:57.045169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:57.045169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:57.045169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:57.045169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:57.047271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 316/631] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:57.048369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.075994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.077256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.077867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.078437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.161435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adc163-e6af-498f-bd9b-cb2f51a873dd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.165330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.166897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.197468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.198530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.199603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.200063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.201027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:57.201632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.203283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.221119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 317/632] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:57.222383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.265724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 316/633] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:57.266555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.327901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce4222-bdef-4bb9-b81a-39ae1133aaf3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.361938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cff8f1-8f83-4a1d-b9f6-f9a63d0bd7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.362602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff8f1-8f83-4a1d-b9f6-f9a63d0bd7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.362877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff8f1-8f83-4a1d-b9f6-f9a63d0bd7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.363174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff8f1-8f83-4a1d-b9f6-f9a63d0bd7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.363984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cff8f1-8f83-4a1d-b9f6-f9a63d0bd7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:57.364294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cff8f1-8f83-4a1d-b9f6-f9a63d0bd7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.365207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14493308-5d19-4e6f-ac90-5e5c62d143cf None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.365662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cff8f1-8f83-4a1d-b9f6-f9a63d0bd7a6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.378831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 318/634] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:57.380162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8c3b-ca58-4fb8-aada-61256f1b738f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.380454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8c3b-ca58-4fb8-aada-61256f1b738f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.380728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8c3b-ca58-4fb8-aada-61256f1b738f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.386069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 319/635] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:57.386867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e8c3b-ca58-4fb8-aada-61256f1b738f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.406372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.407548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.407988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.408422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/6754ef93d9344beeae2a5f2812746025/roles/29b66fdb14844ff6b20ff938a256fd87` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.425148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=6754ef93d9344beeae2a5f2812746025, role_id=29b66fdb14844ff6b20ff938a256fd87)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.426897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.442843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 317/636] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:31:57 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/6754ef93d9344beeae2a5f2812746025/roles/29b66fdb14844ff6b20ff938a256fd87 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:31:57.443691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.507937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e8c3b-ca58-4fb8-aada-61256f1b738f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.561457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d261b-d1af-4d78-8bab-4290b2d84991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.563491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d261b-d1af-4d78-8bab-4290b2d84991 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.563941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d261b-d1af-4d78-8bab-4290b2d84991 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.564372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d261b-d1af-4d78-8bab-4290b2d84991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.579122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a84f7-0d27-4994-b155-34b521a98f69 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.579842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d261b-d1af-4d78-8bab-4290b2d84991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.582660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d261b-d1af-4d78-8bab-4290b2d84991 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-878d261b-d1af-4d78-8bab-4290b2d84991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:57.604550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:57.606285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:57.607206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:57.607206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:57.607206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:57.607206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:57.612638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 320/637] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:57.612638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433b01-ec89-4634-b874-b99fe8b42988 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.612638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433b01-ec89-4634-b874-b99fe8b42988 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.612638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433b01-ec89-4634-b874-b99fe8b42988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.616014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ccb0b-38ec-4936-8835-0db0cc5b0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.616812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ccb0b-38ec-4936-8835-0db0cc5b0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.617087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ccb0b-38ec-4936-8835-0db0cc5b0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.617352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ccb0b-38ec-4936-8835-0db0cc5b0dd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.625961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ccb0b-38ec-4936-8835-0db0cc5b0dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.627420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ccb0b-38ec-4936-8835-0db0cc5b0dd6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.631255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-40433b01-ec89-4634-b874-b99fe8b42988 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:57.632475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-40433b01-ec89-4634-b874-b99fe8b42988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-0f1ccb0b-38ec-4936-8835-0db0cc5b0dd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:57.642883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:57.645776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 318/638] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0618-6a7c-44ec-bd23-a531e7cf0a6e None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.648402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0618-6a7c-44ec-bd23-a531e7cf0a6e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.650210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0618-6a7c-44ec-bd23-a531e7cf0a6e None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.650210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 319/639] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:31:57.650210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0618-6a7c-44ec-bd23-a531e7cf0a6e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.707709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 321/640] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:57.708529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433b01-ec89-4634-b874-b99fe8b42988 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.757070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0618-6a7c-44ec-bd23-a531e7cf0a6e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.791476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00778e-fdbb-47e2-8d09-cc5e9d217591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.792137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00778e-fdbb-47e2-8d09-cc5e9d217591 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.792415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00778e-fdbb-47e2-8d09-cc5e9d217591 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.793285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00778e-fdbb-47e2-8d09-cc5e9d217591 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.794056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00778e-fdbb-47e2-8d09-cc5e9d217591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:57.794362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00778e-fdbb-47e2-8d09-cc5e9d217591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.795710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00778e-fdbb-47e2-8d09-cc5e9d217591 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.810863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 320/641] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:57.810863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6903b-a371-48ed-8cc0-8aab923b6916 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.810863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6903b-a371-48ed-8cc0-8aab923b6916 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.810863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6903b-a371-48ed-8cc0-8aab923b6916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.814436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433b01-ec89-4634-b874-b99fe8b42988 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:57.824829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b6d6903b-a371-48ed-8cc0-8aab923b6916 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:31:57.826105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b6d6903b-a371-48ed-8cc0-8aab923b6916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:31:57.851044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:57.852198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:57.852492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:57.852767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:57.853900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:57.854294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:57.857037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:57.882007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 322/642] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:57.882007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.896091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 321/643] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:31:57.897130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6903b-a371-48ed-8cc0-8aab923b6916 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:57.991353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475eba-0112-4485-9d8c-a809cc42a56a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.001860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6903b-a371-48ed-8cc0-8aab923b6916 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.026788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.028165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.028454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.028725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.034316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.035097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.035375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.035646 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.040340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:58.042296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.043748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:58.048909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:58.050009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:58.050877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:58.055199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 323/644] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:58.055199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:58.057268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:58.058765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:58.059734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:58.063470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 322/645] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:58.064187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.153667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083b01-61d6-4502-9219-d28ce1e7efc8 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.163095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36c71b-aba5-48c3-b51f-aecc36196177 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.188109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.188747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.189025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.189298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.196943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.198023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.198302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.198574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.209744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:31:58.217983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:58.219104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:31:58.220124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:58.223936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 323/646] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:58.224738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.258510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.259970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.320721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ed05-073d-4637-b566-a7c825ec8b2e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.353192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.353883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.354183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.354434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.359567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 324/647] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:31:58.359715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:58.359715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.359898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.359982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.367047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 324/648] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:58.371414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.448586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6b01e-973f-4aaf-ac4d-c933df1896d4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.476847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a83607-3b88-4a81-a371-1149bf7c5ab1 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.493149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.493848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.494131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.494407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.495191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:58.495499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.497460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.514346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 325/649] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:58.514346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.520206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.520947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.521299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.521642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.522481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:58.522861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.524288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.537551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 325/650] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:58.537551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.613275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f1825-9dff-4120-b2b0-915cfcfd6f12 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.639507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94997c08-78a4-4898-9f41-4cce2b5deb10 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.646406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.647139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.647484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.647764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.658599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.660026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:58.677221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:58.678249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:58.679176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:58.679176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:58.679176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:58.679176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:58.679176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 326/651] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:58.679176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.679853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.680642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.680922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.681194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.695380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.696815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:58.716706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:58.717676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:58.718831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:58.718831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:58.718831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:58.718831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:58.724656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 326/652] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:58.724656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.788645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaef87-d805-4626-9b19-d6aa2c02e0d1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.821489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.822252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.822536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.822810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.823636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=a7291e3af37548efafd5e4654569677b) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:58.824527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.826024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.831656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 327/653] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/role_assignments?user.id=a7291e3af37548efafd5e4654569677b&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:58.832428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.858403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c19988-6fb4-4f0b-9f4a-3b0ef9037e95 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.903728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.905385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.905882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.906460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.921979 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.924151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:58.947355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffe349-e623-4d84-bff4-1a28c4866612 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:31:58.948557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:58.949682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:58.950820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:31:58.950820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:31:58.950820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:31:58.950820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:58.958303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 327/654] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:58.958303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:58.992542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:58.993423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:58.993819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:58.994170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:58.994984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:58.995367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:58.997437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.014725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 328/655] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:59.015768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.103178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379f79-a5c6-4c13-bc6c-5a4e642d1ef4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.140948 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.141613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.141924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.142201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.142929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:59.143239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.144608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.155131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952d05-da75-4b73-8a79-2eeec9c22b41 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.157271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 328/656] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:59.158230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.201058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.201756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.202095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.202378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.203114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:59.203420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.204854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.217456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 329/657] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:59.218392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.275211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035ee22-df8b-45af-b55f-849c1dd585e8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.311396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.312192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.312476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.312755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.319075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2d316-2454-4803-bdad-71dafe5aecaf None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.320029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.321495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:31:59.335488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:59.336443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 329/658] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:59.337938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.354322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.355713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.355992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.356264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.365125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.366656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:59.381759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:59.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 330/659] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:59.386288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.442533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda009e-e4c6-4206-adde-236920b150d4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.481954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.482754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.483034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.483307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.486156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152213ec-4c2f-4920-8cb2-70959440eb87 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.491730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.493191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:31:59.510498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:31:59.511491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:31:59.512432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 330/660] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:31:59.513041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.520789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.521498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.521818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.522099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.522901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:59.523210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.524717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.538788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 331/661] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:59.539814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.637222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544e15d-827b-4676-ac75-b94e25caa522 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.643085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07643d28-d5fb-4b17-86c1-04a195d57fbe None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.677318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0862-66d2-495b-b867-08590270265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.678027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0862-66d2-495b-b867-08590270265e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.678313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0862-66d2-495b-b867-08590270265e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.678590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d0862-66d2-495b-b867-08590270265e None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.679427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0862-66d2-495b-b867-08590270265e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:59.679735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0862-66d2-495b-b867-08590270265e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.680438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.681232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d0862-66d2-495b-b867-08590270265e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.681992 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.682486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.683122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.684947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:59.685477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.687142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.699621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 332/662] 10.222.0.58 () {56 vars in 1139 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:59.700547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0862-66d2-495b-b867-08590270265e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.715238 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 331/663] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:59.715416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.806918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d0862-66d2-495b-b867-08590270265e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.820924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51a70f-6a50-4f06-8a8e-87e269d81618 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:31:59.842416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.843067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.843347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.843624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.844452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=59372ef7ca2d439c8a2c12e29f8d97bf) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:31:59.844768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.846244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.861733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 333/664] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/role_assignments?user.id=59372ef7ca2d439c8a2c12e29f8d97bf&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:31:59.861733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:31:59.864625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9fc94-a3d0-401f-a4ae-9e26afd29bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:31:59.865573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9fc94-a3d0-401f-a4ae-9e26afd29bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:31:59.866868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9fc94-a3d0-401f-a4ae-9e26afd29bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:31:59.867162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9fc94-a3d0-401f-a4ae-9e26afd29bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:31:59.959797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9fc94-a3d0-401f-a4ae-9e26afd29bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:31:59.961197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9fc94-a3d0-401f-a4ae-9e26afd29bc9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:31:59.976630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa260a-4da7-40d8-9af4-eebdb64a2e7e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.013336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df560fa-6814-4bf4-88ab-dd55bc80840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.014364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df560fa-6814-4bf4-88ab-dd55bc80840d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.014652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df560fa-6814-4bf4-88ab-dd55bc80840d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.014925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df560fa-6814-4bf4-88ab-dd55bc80840d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.070585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 332/665] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:32:00.072014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7ad5-a678-4102-8bc0-f4b50ff48e8e None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.072305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7ad5-a678-4102-8bc0-f4b50ff48e8e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.072605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7ad5-a678-4102-8bc0-f4b50ff48e8e None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.078776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 333/666] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:00.079548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e7ad5-a678-4102-8bc0-f4b50ff48e8e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.098947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df560fa-6814-4bf4-88ab-dd55bc80840d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.100462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df560fa-6814-4bf4-88ab-dd55bc80840d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.215640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e7ad5-a678-4102-8bc0-f4b50ff48e8e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.223742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 334/667] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:32:00.225101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b493-5385-4228-aa04-ec426363ed92 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.225387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b493-5385-4228-aa04-ec426363ed92 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.225663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b493-5385-4228-aa04-ec426363ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.241769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3365b493-5385-4228-aa04-ec426363ed92 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:00.242967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3365b493-5385-4228-aa04-ec426363ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:00.253126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.254270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.254798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.255364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.267015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.268773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:00.287856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:00.288987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:00.290162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:00.290162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:00.290162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:00.290162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:00.291776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 334/668] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:00.293446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.327214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 335/669] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:32:00.334713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365b493-5385-4228-aa04-ec426363ed92 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.394974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbaf70-325e-46a6-8d68-49a3ba30db54 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.431509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.432572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.433034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.433479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.445665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.447706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.457093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365b493-5385-4228-aa04-ec426363ed92 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:00.468959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:00.470003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:00.470907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:00.470907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:00.470907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:00.470907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:00.473168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 335/670] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:00.474279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.493971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.494442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.494724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.495043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.495798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:00.496103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.497472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.509338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 336/671] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:00.510201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.578091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb73a8-1d63-4f58-a21e-5c0dc626d695 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.610226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62dfd-eaff-4430-a81e-63f3d1c5d85c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.612913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.613967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.614455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.614930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.625652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:00.633631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:00.634568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:00.635421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:00.638701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 336/672] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:00.639765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.644708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.645226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.645226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.645497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.646209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:00.646516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.647882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.662563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 337/673] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:00.663458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.745799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e501-62f1-4902-8ee6-32ed98e215d9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.766432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896162-91eb-4ea1-a06e-edfb58527ee1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.783624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.784786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.785271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.785786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.793896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.795653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.809347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.810064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.810344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.810675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.811428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:00.811786 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:00.812796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:00.813680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:00.814613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:00.815050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.817224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 337/674] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:00.818394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.823180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 338/675] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:00.823674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.921640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a62c-aef8-4145-99c6-4d393693fa74 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.925870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66487a73-3415-4d0e-b9e7-a2766521172f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:00.957197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.958599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.959187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.959681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.960629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:00.961417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:00.961825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:00.962262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:00.963309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:00.963566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.965624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.968536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:00.970147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:00.978333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 339/676] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:00.979307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:00.985518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:00.986522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:00.987442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:00.989899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 338/677] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:00.990915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.080566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db0a9-1bde-40ab-8344-0a10f21420fc None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.091276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304213-3cf9-4859-b30e-d65d1e211918 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.125626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.126620 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.126964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.127387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.134064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.135083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.135556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.136060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.137223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=9c1c4e1fe220486ab672b3dea6ffdfec) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:01.137773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.139458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.139585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.141147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.147472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 339/678] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/role_assignments?user.id=9c1c4e1fe220486ab672b3dea6ffdfec&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:01.148731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:01.161379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:01.162454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:01.163746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:01.163746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:01.163746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:01.163746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:01.163746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 340/679] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:01.173734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.335484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eae958-0d35-4083-8003-c2380c852c46 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.377152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661ccf4-ac98-410e-94bb-a8ae2a4028c4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.379000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5397874-218b-48cb-ba7f-42cb163086b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.379666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397874-218b-48cb-ba7f-42cb163086b5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.379950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397874-218b-48cb-ba7f-42cb163086b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.380229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397874-218b-48cb-ba7f-42cb163086b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.380949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5397874-218b-48cb-ba7f-42cb163086b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:01.381260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5397874-218b-48cb-ba7f-42cb163086b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.382664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5397874-218b-48cb-ba7f-42cb163086b5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.395573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 341/680] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:01.396863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f3a3-6ab4-4722-92f4-2c7665c31934 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.397146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f3a3-6ab4-4722-92f4-2c7665c31934 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.397421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f3a3-6ab4-4722-92f4-2c7665c31934 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.398840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 342/681] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:01.401039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1f3a3-6ab4-4722-92f4-2c7665c31934 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.434446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f970b-2b6c-47dd-9bf3-19dd08e18218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.435283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f970b-2b6c-47dd-9bf3-19dd08e18218 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.435822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f970b-2b6c-47dd-9bf3-19dd08e18218 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.436272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f970b-2b6c-47dd-9bf3-19dd08e18218 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.437830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f970b-2b6c-47dd-9bf3-19dd08e18218 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:01.438418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f970b-2b6c-47dd-9bf3-19dd08e18218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.439950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f970b-2b6c-47dd-9bf3-19dd08e18218 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.459210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 340/682] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:01.464961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf30432-2b02-44a0-9654-569875b63540 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.464961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf30432-2b02-44a0-9654-569875b63540 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.464961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf30432-2b02-44a0-9654-569875b63540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.484877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8cf30432-2b02-44a0-9654-569875b63540 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:01.486527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8cf30432-2b02-44a0-9654-569875b63540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:01.529499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1f3a3-6ab4-4722-92f4-2c7665c31934 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.564123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.564899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.565180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.565453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.573138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.575304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.581726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 341/683] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:32:01.581726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf30432-2b02-44a0-9654-569875b63540 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:01.601760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:01.602728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:01.603743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 343/684] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:01.610763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.710294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf30432-2b02-44a0-9654-569875b63540 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.712334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c16dd9-4bc6-4823-8a05-4d508cd4dfb2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.746037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.747416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.747541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.748001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.748345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.748634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.748917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.750003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.750854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=d990142782ed4f2f92e51c2a76693009) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:01.751174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.752594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.759915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.761421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.766178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 342/685] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/role_assignments?user.id=d990142782ed4f2f92e51c2a76693009&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:01.767154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:01.779914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:01.780881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:01.781856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:01.781856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:01.781856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:01.781856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:01.781856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 344/686] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:01.800780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.887963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddd13-668c-4a19-9561-8c4369d1abe5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.908205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec805d-676e-496c-8161-08fffe29980e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:01.924005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.924681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.924956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.925220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.926092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:01.926397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.927837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.947652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 343/687] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:01.953231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:01.955958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:01.956642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:01.956924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:01.957202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:01.957966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:01.958273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:01.959736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:01.982827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 345/688] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:01.990276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:02.066340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc8ed-e9fd-43f3-9186-2c1354d49697 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:02.100616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa954d1-e26c-4d34-aa31-232f3b197e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:02.101262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa954d1-e26c-4d34-aa31-232f3b197e48 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.101539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa954d1-e26c-4d34-aa31-232f3b197e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.101844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa954d1-e26c-4d34-aa31-232f3b197e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.131602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aba8b-33f6-4435-968b-006454f4ae12 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:02.179471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:02.180664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.181773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.182266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.183575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:02.183696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa954d1-e26c-4d34-aa31-232f3b197e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:02.185268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa954d1-e26c-4d34-aa31-232f3b197e48 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:02.185653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:02.217863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 346/689] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:32:01 2022] POST /identity/v3/users => generated 254 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:32:02.311952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 344/690] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 11:32:02.317415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:02.379978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735075-e940-4e4d-9fa5-d073f02c1cf8 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.380350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735075-e940-4e4d-9fa5-d073f02c1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.380515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735075-e940-4e4d-9fa5-d073f02c1cf8 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.382296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 345/691] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:02.388563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210b628-cee9-48aa-ba9a-1be8f263c78e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.388917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210b628-cee9-48aa-ba9a-1be8f263c78e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.389128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210b628-cee9-48aa-ba9a-1be8f263c78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.406812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4210b628-cee9-48aa-ba9a-1be8f263c78e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:02.408018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4210b628-cee9-48aa-ba9a-1be8f263c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:02.475587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e767f7-4eb1-498f-9a42-bedf3d777507 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:02.503417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 346/692] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:32:02.527639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:02.529230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210b628-cee9-48aa-ba9a-1be8f263c78e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:02.530324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.530829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.531316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.545834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:02.547647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:02.565407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:02.566441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:02.567333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:02.567333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:02.567333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:02.567333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:02.569886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 347/693] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:02.580415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:02.640567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210b628-cee9-48aa-ba9a-1be8f263c78e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:02.681368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:02.682390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.682390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.683698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.687330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9d747-5405-4329-a7fb-2200a4f8766a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:02.693972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:02.703937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:02.704912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:02.705793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:02.710149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 347/694] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:02.711633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:02.729803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:02.731124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.731628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.732106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.733032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:02.733539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:02.735154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:02.749502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 348/695] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:02.758863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:02.832348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6d6fb-1466-410b-8aef-136ff8caec7f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:02.873726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515c7a3-af6e-47f4-8429-f52bfdb1c6ed None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:02.882423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:02.883446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.883942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.884419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.885371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:02.885942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:02.887803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:02.901347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 348/696] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:02.907677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:02.907816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:02.908561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:02.908843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:02.909112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:02.917004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:02.925722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:02.933999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:02.934888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:02.936376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 349/697] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:02.940694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:03.044154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f301f2e-eb0f-4a23-a54a-b7bccf62c7a6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:03.051051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327daf-f5b6-4153-b1a2-37488cd5802a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:03.080064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:03.080724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.081001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.081275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.082107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:03.082414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:03.083844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:03.100858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 350/698] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:03.102299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:03.108282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:03.109368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.109914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.110390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.129827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:03.131753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:03.163062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:03.164023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:03.164924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:03.164924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:03.164924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:03.164924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:03.170399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 349/699] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:03.174895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:03.209244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4817e-1660-4398-870d-e624bcdf529c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:03.243414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:03.244089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.244365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.244636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.246027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=6754ef93d9344beeae2a5f2812746025) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:03.246333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:03.247761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:03.258398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 351/700] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:03 2022] GET /identity/v3/role_assignments?user.id=6754ef93d9344beeae2a5f2812746025&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:03.336767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c9aa-29d2-448d-8f52-a860a1e279da None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:03.381429 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:03.382546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.383054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.383533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.384485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:03.384997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:03.386704 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:03.404928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 350/701] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:03.411389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:03.559895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a2c03-a153-4e86-aef7-ec4072875bd8 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:03.599195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:03.599963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.600245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.600516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.610449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:03.611891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:03.629551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:03.630650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:03.632292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 352/702] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:32:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:03.638920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:03.760067 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd9cab-4212-432b-9d0f-a88c2da89b0b None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:03.794300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bf6f3-8649-4882-8241-4b22db8859d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:03.794971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf6f3-8649-4882-8241-4b22db8859d6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.795253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf6f3-8649-4882-8241-4b22db8859d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.795527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf6f3-8649-4882-8241-4b22db8859d6 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.796362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf6f3-8649-4882-8241-4b22db8859d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:03.796667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf6f3-8649-4882-8241-4b22db8859d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:03.798108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf6f3-8649-4882-8241-4b22db8859d6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:03.815530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 351/703] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:32:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:03.821231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:03.860953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba083f-cc6f-4303-a532-787704752a59 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.861457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba083f-cc6f-4303-a532-787704752a59 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.861457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba083f-cc6f-4303-a532-787704752a59 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.863036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 352/704] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:03.870088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a30e2-7624-47f9-9789-248cc9266e56 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:03.870088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a30e2-7624-47f9-9789-248cc9266e56 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:03.870088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a30e2-7624-47f9-9789-248cc9266e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:03.891515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e03a30e2-7624-47f9-9789-248cc9266e56 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:03.893494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e03a30e2-7624-47f9-9789-248cc9266e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:03.969726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68317-9b09-4ffd-a710-55cea0a12128 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:03.988025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 353/705] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:32:04.010698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a30e2-7624-47f9-9789-248cc9266e56 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:04.011629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:04.012308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.012586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.012855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.132219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:04.133614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:04.193172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a30e2-7624-47f9-9789-248cc9266e56 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:04.241756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:04.241756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.241756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.242376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.243207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:04.244753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:04.259280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:04.260361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:04.261232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:04.264161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 354/706] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:04.270066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:04.296234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 353/707] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:32:04.302240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:04.433825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e802122-4c4f-4a4b-8f33-2977ab76a433 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:04.475601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:04.476395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.476676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.476953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.488276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:04.489841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:04.507854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c0c8-3989-423e-bf33-d2210eda48b6 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:04.510131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:04.511652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:04.512546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:04.512546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:04.512546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:04.512546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:04.512546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 354/708] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:04.522249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:04.566475 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:04.567154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.567433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.567708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.568425 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] RBAC: Adding query filter params (name=network) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:04.568728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:04.570399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:04.583240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 355/709] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:04.589931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:04.682899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8126532-4dc5-4af3-af74-f54a3ef3b82e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:04.716943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abdc14-7bdc-45ef-9388-51035198e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:04.717527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abdc14-7bdc-45ef-9388-51035198e44c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.717880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abdc14-7bdc-45ef-9388-51035198e44c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.718157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abdc14-7bdc-45ef-9388-51035198e44c None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.718925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abdc14-7bdc-45ef-9388-51035198e44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:04.719237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abdc14-7bdc-45ef-9388-51035198e44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:04.720601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abdc14-7bdc-45ef-9388-51035198e44c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:04.730383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632b568-ad1d-46d9-83e0-a41774f5f2bc None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:04.733455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 355/710] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:04.734776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9f459-206b-4fd8-89f3-de5b3a5b93fb None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.735061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9f459-206b-4fd8-89f3-de5b3a5b93fb None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.735339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9f459-206b-4fd8-89f3-de5b3a5b93fb None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.736548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 356/711] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:04.741659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9f459-206b-4fd8-89f3-de5b3a5b93fb None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:04.769032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97139fd-9178-47c6-b288-d7b78bf9129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:04.769712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97139fd-9178-47c6-b288-d7b78bf9129d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.770008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97139fd-9178-47c6-b288-d7b78bf9129d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.770285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97139fd-9178-47c6-b288-d7b78bf9129d None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.770991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97139fd-9178-47c6-b288-d7b78bf9129d None admin] RBAC: Adding query filter params (type=network) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:04.771297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97139fd-9178-47c6-b288-d7b78bf9129d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:04.772667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97139fd-9178-47c6-b288-d7b78bf9129d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:04.779629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 356/712] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:04.780916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862b89-62a7-413e-863b-0ecb683b38a9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.781206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862b89-62a7-413e-863b-0ecb683b38a9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.781486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862b89-62a7-413e-863b-0ecb683b38a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.799387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bd862b89-62a7-413e-863b-0ecb683b38a9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:04.800613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bd862b89-62a7-413e-863b-0ecb683b38a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:04.849365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9f459-206b-4fd8-89f3-de5b3a5b93fb None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:04.878965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 357/713] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:32:04.894626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:04.895501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:04.895779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:04.896105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:04.904189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd862b89-62a7-413e-863b-0ecb683b38a9 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:04.905065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:04.906628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:04.922277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:04.924645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:04.926835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 357/714] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:04.935835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:05.070462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc963f0-00d3-4c23-aa81-40f7776ac58e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:05.072944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd862b89-62a7-413e-863b-0ecb683b38a9 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:05.109277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:05.110112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.110406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.110642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:05.110845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.111454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.111630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:05.111781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.111928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:05.112073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.112658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:05.113195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:05.114037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:05.127053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 358/715] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:05.127938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:05.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:05.131599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 358/716] 10.222.0.58 () {56 vars in 1129 bytes} [Thu May 12 11:32:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:05.133554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:05.137209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:05.241596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b650e-35a4-43cf-959e-f12f87808045 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:05.243489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849555-08a3-415f-949e-cc5c90cbd8a4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:05.277284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4565912-f7d2-4928-b764-0d9b07349efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:05.278052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565912-f7d2-4928-b764-0d9b07349efa None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.278289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b625b1-7504-45d0-9db4-b29e9bb41c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:05.278474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565912-f7d2-4928-b764-0d9b07349efa None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.278623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565912-f7d2-4928-b764-0d9b07349efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.278951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b625b1-7504-45d0-9db4-b29e9bb41c18 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.279234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b625b1-7504-45d0-9db4-b29e9bb41c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.279394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4565912-f7d2-4928-b764-0d9b07349efa None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=59372ef7ca2d439c8a2c12e29f8d97bf) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:05.279542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b625b1-7504-45d0-9db4-b29e9bb41c18 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.279705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4565912-f7d2-4928-b764-0d9b07349efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:05.280204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b625b1-7504-45d0-9db4-b29e9bb41c18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:05.280511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b625b1-7504-45d0-9db4-b29e9bb41c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:05.281123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4565912-f7d2-4928-b764-0d9b07349efa None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:05.281895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b625b1-7504-45d0-9db4-b29e9bb41c18 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:05.286630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 359/717] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 12 11:32:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:05.287875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba1d47-9ef6-4f54-8b71-82d125a56130 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.288161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba1d47-9ef6-4f54-8b71-82d125a56130 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.288437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba1d47-9ef6-4f54-8b71-82d125a56130 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.290000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 360/718] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:05.290213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 359/719] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:05 2022] GET /identity/v3/role_assignments?user.id=59372ef7ca2d439c8a2c12e29f8d97bf&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:05.294905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba1d47-9ef6-4f54-8b71-82d125a56130 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:05.297030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287db0b-a282-4164-8185-dc34397f2f3d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.297322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287db0b-a282-4164-8185-dc34397f2f3d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.297603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287db0b-a282-4164-8185-dc34397f2f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.315413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3287db0b-a282-4164-8185-dc34397f2f3d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:05.316642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3287db0b-a282-4164-8185-dc34397f2f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:05.397925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 360/720] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 11:32:05.415953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287db0b-a282-4164-8185-dc34397f2f3d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:05.539658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287db0b-a282-4164-8185-dc34397f2f3d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:05.562897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba1d47-9ef6-4f54-8b71-82d125a56130 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:05.611306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:05.612152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.612432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.612703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.629339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:05.641424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:05.642004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.642282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.642552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.643261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:05.643562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:05.644920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:05.646441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:05.648568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:05.650665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 361/721] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:32:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:05.657798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:05.660527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 361/722] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 12 11:32:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:05.777256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d79d6-d871-4214-8cce-f7d83400870d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:05.823322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:05.823322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:05.823322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:05.823322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:05.824117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:05.824261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:05.826109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:05.837681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 362/723] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:32:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:05.841103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:05.975820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168b12-350c-42fe-a505-4a2598030ec0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:06.015218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92f76f-d420-4f78-88f9-89747bf3042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:06.016019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f76f-d420-4f78-88f9-89747bf3042d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:06.016305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f76f-d420-4f78-88f9-89747bf3042d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:06.016584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f76f-d420-4f78-88f9-89747bf3042d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:06.027582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92f76f-d420-4f78-88f9-89747bf3042d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:06.029102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92f76f-d420-4f78-88f9-89747bf3042d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-ef92f76f-d420-4f78-88f9-89747bf3042d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:06.055052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:06.057154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:06.059875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:06.059875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:06.059875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:06.059875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:06.059875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 362/724] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:06.062699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:06.222696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bda53-f28e-4edb-a7b4-5b8edd08c898 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:06.267301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:06.267974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:06.268257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:06.268531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:06.269258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:06.269564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:06.270965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:06.292709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed73f9a-7f39-4fbf-b748-e4738c663fb4 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:06.293031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed73f9a-7f39-4fbf-b748-e4738c663fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:06.293261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed73f9a-7f39-4fbf-b748-e4738c663fb4 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:06.294773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 363/725] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:06.300783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda4ec1-355a-4d18-b4f9-6ce6b2035fce None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:06.301096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda4ec1-355a-4d18-b4f9-6ce6b2035fce None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:06.301336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda4ec1-355a-4d18-b4f9-6ce6b2035fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:06.331678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-1bda4ec1-355a-4d18-b4f9-6ce6b2035fce None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:06.332913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1bda4ec1-355a-4d18-b4f9-6ce6b2035fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:06.418837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 363/726] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:06.419732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:06.471090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 364/727] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:32:06.498177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda4ec1-355a-4d18-b4f9-6ce6b2035fce None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:06.622679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e7008-577d-4936-b6c7-64446f814ddd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:06.662311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda4ec1-355a-4d18-b4f9-6ce6b2035fce None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:06.689857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:06.690667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:06.690947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:06.691220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:06.706658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:06.708121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:06.732102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:06.733110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:06.734143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 364/728] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:32:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:06.735845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:06.736639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:06.736918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:06.737190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:06.744075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:06.750833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:06.758706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:06.759765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:06.760645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 365/729] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:06.773269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:06.908384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efd31b-c1e0-46bc-9161-7c13717e8141 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:06.945036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:06.946096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:06.946636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:06.947150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:06.948175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:06.949301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:06.951607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:06.953355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec68fd-91fd-479f-954e-2d1e49150292 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:06.961903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 366/730] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:06.968998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:07.024719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:07.025391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.025673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.026115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.027515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:07.027824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:07.029778 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:07.062586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 365/731] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 12 11:32:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:07.068303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:07.139683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4d67e-536a-4e1b-970c-32e956b037e6 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:07.199093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:07.201316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.202730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.203215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.228050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:07.230413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:07.244375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdddc5-2497-4ee5-83a4-abd10846b787 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:07.269484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:07.270470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:07.271384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:07.271384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:07.271384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:07.271384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:07.279082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 367/732] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:07.287079 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:07.302410 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:07.303565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.304057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.304550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.441046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:07.442552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:07.455390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517bbe-5569-4c18-a611-8856fafd265f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:07.550422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:07.551172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.551389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.551673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.552413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:07.552727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:07.554126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:07.575315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 366/733] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:32:07.579885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 368/734] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:07.580711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:07.595520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:07.692347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37405e8-b097-40c5-8b3e-608b0834f0d4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:07.731914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:07.733035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.733520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.734015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.745688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:07.747787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:07.767554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:07.768531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:07.769490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:07.769490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:07.769490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:07.769490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:07.772123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 367/735] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:07.779339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:07.822950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f8e8-ffb5-4f75-97db-cebac72c1a39 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:07.861386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f304ebc-0b13-4b50-b7d3-a29bbcd2eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:07.862622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f304ebc-0b13-4b50-b7d3-a29bbcd2eec0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.863106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f304ebc-0b13-4b50-b7d3-a29bbcd2eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.863613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f304ebc-0b13-4b50-b7d3-a29bbcd2eec0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.871843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f304ebc-0b13-4b50-b7d3-a29bbcd2eec0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:07.873644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f304ebc-0b13-4b50-b7d3-a29bbcd2eec0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-7f304ebc-0b13-4b50-b7d3-a29bbcd2eec0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:07.889540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:07.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:07.892919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:07.893650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db78d3-96be-4731-abab-24fe0bbac3f1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:07.894600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 369/736] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:07.895802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea503-9e5b-42a9-aeaa-2f3ae7096e4b None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.896090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea503-9e5b-42a9-aeaa-2f3ae7096e4b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.896363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea503-9e5b-42a9-aeaa-2f3ae7096e4b None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.897771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 370/737] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:07.903097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ea503-9e5b-42a9-aeaa-2f3ae7096e4b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:07.940755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166204a3-ccb2-478b-8e0f-3acc79e5805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:07.941793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166204a3-ccb2-478b-8e0f-3acc79e5805a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.942282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166204a3-ccb2-478b-8e0f-3acc79e5805a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.942869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166204a3-ccb2-478b-8e0f-3acc79e5805a None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.944245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166204a3-ccb2-478b-8e0f-3acc79e5805a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:07.945033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166204a3-ccb2-478b-8e0f-3acc79e5805a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:07.947038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166204a3-ccb2-478b-8e0f-3acc79e5805a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:07.959616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 368/738] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:07.960893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924fc5f-c026-4255-9d23-314268345397 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:07.961178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924fc5f-c026-4255-9d23-314268345397 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:07.961451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924fc5f-c026-4255-9d23-314268345397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:07.977905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c924fc5f-c026-4255-9d23-314268345397 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:07.979073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c924fc5f-c026-4255-9d23-314268345397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:08.020994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ea503-9e5b-42a9-aeaa-2f3ae7096e4b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.050039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 369/739] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:32:08.051310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924fc5f-c026-4255-9d23-314268345397 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.060290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3b46b-50c9-4728-b650-b77a85a73b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.060985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b46b-50c9-4728-b650-b77a85a73b38 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.061276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b46b-50c9-4728-b650-b77a85a73b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.061552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b46b-50c9-4728-b650-b77a85a73b38 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.062477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3b46b-50c9-4728-b650-b77a85a73b38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:08.062789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3b46b-50c9-4728-b650-b77a85a73b38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.064280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3b46b-50c9-4728-b650-b77a85a73b38 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.084077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 371/740] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 12 11:32:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:08.085381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3801-7ba6-45f8-a6b8-c6f8b941b973 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.085672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3801-7ba6-45f8-a6b8-c6f8b941b973 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.085977 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3801-7ba6-45f8-a6b8-c6f8b941b973 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.087211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 372/741] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:08.087865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc3801-7ba6-45f8-a6b8-c6f8b941b973 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.164377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924fc5f-c026-4255-9d23-314268345397 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.187644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc3801-7ba6-45f8-a6b8-c6f8b941b973 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.197871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.199172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.199454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.199731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.206248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.207697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:08.221759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:08.222677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:08.223570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:08.227378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5be1b-2730-47cf-9946-c150e23ba73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.227601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 370/742] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:08.228406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5be1b-2730-47cf-9946-c150e23ba73c None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.228536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.228694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5be1b-2730-47cf-9946-c150e23ba73c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.228957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5be1b-2730-47cf-9946-c150e23ba73c None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.229771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5be1b-2730-47cf-9946-c150e23ba73c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.231135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5be1b-2730-47cf-9946-c150e23ba73c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.254291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 373/743] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:08 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:08.254291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69700-b6cf-4b5c-8699-b5c946015194 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.254291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69700-b6cf-4b5c-8699-b5c946015194 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.254291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69700-b6cf-4b5c-8699-b5c946015194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.266538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-dfa69700-b6cf-4b5c-8699-b5c946015194 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:08.267767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dfa69700-b6cf-4b5c-8699-b5c946015194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:08.353296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 374/744] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:08 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:32:08.354202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69700-b6cf-4b5c-8699-b5c946015194 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.368232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeec12-e4a1-4c5f-81e4-99c3fdb6185f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.405092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.405776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.406062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.406348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.463097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69700-b6cf-4b5c-8699-b5c946015194 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.483335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.484781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.496505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2decbe6-2dd4-49dd-9bac-62a127e4881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.497623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2decbe6-2dd4-49dd-9bac-62a127e4881f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.497932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2decbe6-2dd4-49dd-9bac-62a127e4881f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.498212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2decbe6-2dd4-49dd-9bac-62a127e4881f None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.499009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2decbe6-2dd4-49dd-9bac-62a127e4881f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:08.499322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2decbe6-2dd4-49dd-9bac-62a127e4881f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.500761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2decbe6-2dd4-49dd-9bac-62a127e4881f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.513374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 375/745] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:08.514679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d912af3-6b5f-40f5-9c46-0407d562f2e4 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.514967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d912af3-6b5f-40f5-9c46-0407d562f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.515247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d912af3-6b5f-40f5-9c46-0407d562f2e4 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.520451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 376/746] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:08.520451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d912af3-6b5f-40f5-9c46-0407d562f2e4 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.593765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 371/747] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 11:32:08.594892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.615829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d912af3-6b5f-40f5-9c46-0407d562f2e4 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.648754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cfd4a-c5b1-4222-86d1-f497941231cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.649538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfd4a-c5b1-4222-86d1-f497941231cd None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.649854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfd4a-c5b1-4222-86d1-f497941231cd None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.650132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfd4a-c5b1-4222-86d1-f497941231cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.660053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cfd4a-c5b1-4222-86d1-f497941231cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-046cfd4a-c5b1-4222-86d1-f497941231cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:08.668374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:08.669514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:08.670572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 377/748] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:08.671279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fbdb5-81bd-4b1e-b6e3-bd979da200d4 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.671373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fbdb5-81bd-4b1e-b6e3-bd979da200d4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.671648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fbdb5-81bd-4b1e-b6e3-bd979da200d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.688080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-df7fbdb5-81bd-4b1e-b6e3-bd979da200d4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:08.689243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-df7fbdb5-81bd-4b1e-b6e3-bd979da200d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:08.696073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf0329-ded5-4b3c-bf16-4867b11a4e9d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.729268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.729977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.730370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.730612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.731350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=7f0ef19cf7fb4fb2992d5b040fe80190) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:08.731645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.733063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.745724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 372/749] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/role_assignments?user.id=7f0ef19cf7fb4fb2992d5b040fe80190&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:08.745724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.766330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 378/750] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:08 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 11:32:08.767285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fbdb5-81bd-4b1e-b6e3-bd979da200d4 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.853836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869f080-8680-4c65-98ed-65632041b3cf None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.883944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fbdb5-81bd-4b1e-b6e3-bd979da200d4 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:08.890091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.890892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.891414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.891701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.904456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.905981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.921514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:08.922201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:08.922483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:08.922759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:08.923514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:08.923819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:08.924560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:08.925412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:08.926383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:08.926383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:08.926383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:08.926383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:08.926607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:08.926678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 373/751] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:08.927135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:08.935997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 379/752] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:08.936288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.051599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a643b2-657d-4162-973e-c7e92e0a74eb None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.090061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.090746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.091028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.091305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.092038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.093447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.111579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 374/753] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:08 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:09.112518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.235471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef8ed1-b27d-4187-b90c-83577b171723 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.243979 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d787307-9826-422a-bbb8-eac061bd56d9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.280803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.281609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.281919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.282247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.296199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.298649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:09.317672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:09.320560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:09.322830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:09.322830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:09.322830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:09.322830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:09.322830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 375/754] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:09.324049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.324049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.324049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.324049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.324700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:09.324700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.330818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.331088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.362120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 380/755] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:09.367433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.464765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44852-923b-483a-9dac-de73c4286cc5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.484075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca44d92-059f-46a8-bc16-fc359bf1000f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.516988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.518212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.518772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.519251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.519372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.520269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.520509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:09.520612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.520938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.521273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.523113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.533725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.533725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.543353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 376/756] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:09.548717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:09.549612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:09.550580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 381/757] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:09.551593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.558032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.681563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614964df-4461-4204-8858-5e79e6d8417d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.711985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfb39-a6d3-4a83-85dd-345496e19ea0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.724898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.725633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.725945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.726221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.736756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.738341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.749377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.750319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.750808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.751303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.752293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:09.752856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.754778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:09.766081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:09.767034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:09.767995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 377/758] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:32:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:09.775109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.775573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 382/759] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:09.781984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:09.920972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b40af2-30b3-4f24-ad1e-3f96c289dacc None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.927607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81c58e-375a-4f52-a91e-fef35944a48d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:09.980760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.981822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.982481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.983835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.985396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:09.986872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.988515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:09.990244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:09.991136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:09.993247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:09.993769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:09.994813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=6754ef93d9344beeae2a5f2812746025) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:09.996753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:09.998451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:10.009790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 383/760] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:09 2022] GET /identity/v3/role_assignments?user.id=6754ef93d9344beeae2a5f2812746025&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:10.027156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 378/761] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:32:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:10.032910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:10.153572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362c88-adf5-49b0-bfba-618e225abd78 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:10.203532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:10.204727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:10.205235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:10.205730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:10.224650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:10.226500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:10.246138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:10.247494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:10.248411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:10.248411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:10.248411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:10.248411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:10.250677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 384/762] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:10.256494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:10.393262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af55f9-f5d5-4486-b8e7-31d6ab695842 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:10.426937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:10.427597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:10.427878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:10.428149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:10.428875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:10.429179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:10.430574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:10.442731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 379/763] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:10.448868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:10.569694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448d40-4ffe-4ce8-99c5-ec87be226e88 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:10.607696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41352f76-ea7a-4cc5-808d-97f111ab2c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:10.608845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41352f76-ea7a-4cc5-808d-97f111ab2c1c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:10.609353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41352f76-ea7a-4cc5-808d-97f111ab2c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:10.609885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41352f76-ea7a-4cc5-808d-97f111ab2c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:10.617089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41352f76-ea7a-4cc5-808d-97f111ab2c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:10.618804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41352f76-ea7a-4cc5-808d-97f111ab2c1c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-41352f76-ea7a-4cc5-808d-97f111ab2c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:10.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:10.634890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:10.636374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:10.638849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 385/764] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:10.646853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:10.769069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4ada-3ab4-4d7c-a6cf-405eb886bd92 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:10.809209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56858a3-6e7e-47ff-a6e0-fdec931a44f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:10.809895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56858a3-6e7e-47ff-a6e0-fdec931a44f4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:10.810180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56858a3-6e7e-47ff-a6e0-fdec931a44f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:10.810453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56858a3-6e7e-47ff-a6e0-fdec931a44f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:10.811245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56858a3-6e7e-47ff-a6e0-fdec931a44f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:10.811553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56858a3-6e7e-47ff-a6e0-fdec931a44f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:10.812989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56858a3-6e7e-47ff-a6e0-fdec931a44f4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:10.830777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 380/765] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:10.832033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df389-ce86-4ee8-90fc-4392ed80d778 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:10.832394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df389-ce86-4ee8-90fc-4392ed80d778 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:10.832787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df389-ce86-4ee8-90fc-4392ed80d778 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:10.834510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 386/766] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:10.839907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bf96e-7e5d-4e75-804c-318cd38b5cb9 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:10.840452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bf96e-7e5d-4e75-804c-318cd38b5cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:10.840918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bf96e-7e5d-4e75-804c-318cd38b5cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:10.844303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df389-ce86-4ee8-90fc-4392ed80d778 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:10.859090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e45bf96e-7e5d-4e75-804c-318cd38b5cb9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:10.860911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e45bf96e-7e5d-4e75-804c-318cd38b5cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:10.936182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 381/767] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:10.958475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bf96e-7e5d-4e75-804c-318cd38b5cb9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.061590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bf96e-7e5d-4e75-804c-318cd38b5cb9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.083467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df389-ce86-4ee8-90fc-4392ed80d778 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.101729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.101729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.101729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.101729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] PATH_INFO: `/v3/services/network` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.102148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:11.102148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:11.114403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:11.115431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:11.116292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 382/768] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:10 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:11.123721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.148433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d82b-1858-487c-8607-e115067a6987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.149376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d82b-1858-487c-8607-e115067a6987 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.149659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d82b-1858-487c-8607-e115067a6987 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.150018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d82b-1858-487c-8607-e115067a6987 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/59372ef7ca2d439c8a2c12e29f8d97bf/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.152588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d82b-1858-487c-8607-e115067a6987 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=59372ef7ca2d439c8a2c12e29f8d97bf, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:11.154133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d82b-1858-487c-8607-e115067a6987 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:11.171286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 387/769] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:32:10 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/59372ef7ca2d439c8a2c12e29f8d97bf/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:32:11.199482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aa6d4-30e5-43df-9204-5063a76f34be None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.199783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aa6d4-30e5-43df-9204-5063a76f34be None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.199953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aa6d4-30e5-43df-9204-5063a76f34be None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.201296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 388/770] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:11.211274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e830e1-ab18-4cb8-bf67-01a852a9e152 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.211576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e830e1-ab18-4cb8-bf67-01a852a9e152 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.211810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e830e1-ab18-4cb8-bf67-01a852a9e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.259234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d835-5b4f-4409-9235-4510fd4b6fce None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.262840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-02e830e1-ab18-4cb8-bf67-01a852a9e152 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:11.264063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-02e830e1-ab18-4cb8-bf67-01a852a9e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:11.302517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.303230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.303510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.303785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.304510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] RBAC: Adding query filter params (name=network) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:11.304817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:11.306285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:11.316322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 383/771] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:11.322561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.392733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 389/772] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:11.418162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e830e1-ab18-4cb8-bf67-01a852a9e152 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.464619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285bcb-b989-4d0b-9ae9-fadf32a44160 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.499526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.500192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.500474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.500748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.501515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] RBAC: Adding query filter params (type=network) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:11.501796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:11.509726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:11.514055 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 384/773] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:11.515703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.538465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e830e1-ab18-4cb8-bf67-01a852a9e152 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.583934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.584748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.585032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.585499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.599793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:11.610089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:11.611020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:11.611859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:11.613176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 390/774] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:32:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:11.618686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.635242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8a8b-4f4b-46a2-97c3-51f9d193772f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.706025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.706687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.706967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.707313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.708118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] RBAC: Adding query filter params (interface=public, service_id=0c8d5ddf6fd846d380eaaf9bd266aa22, region_id=RegionOne) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:11.708428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:11.709828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:11.727893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 385/775] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:32:11 2022] GET /identity/v3/endpoints?service_id=0c8d5ddf6fd846d380eaaf9bd266aa22&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:11.733285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.806299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ab209-49bc-4122-bac8-3c2f7d4b1865 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.841099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.841854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.842137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.842409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.843199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:11.843509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:11.844979 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:11.853440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 391/776] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:32:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:11.858980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:11.928404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44dd3c-84cb-4941-a71c-b21ea451b457 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.962177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e5b91-9b0e-4f1e-b16f-83a97e7e4229 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:11.962852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.963516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.964352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:11.964626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:11.965308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:11.966706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:11.972076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 386/777] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:11 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:11.998794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:11.999615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:11.999892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.000164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.012371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:12.013849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:12.032775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:12.035025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:12.037394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:12.037394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:12.037394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:12.037394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:12.037394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 392/778] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:12.043107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:12.208558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1e3a-b965-49ad-845f-1351f27ff340 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:12.249056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422a887-a988-4862-ad23-63c29c3f4d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:12.250337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422a887-a988-4862-ad23-63c29c3f4d52 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.251969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422a887-a988-4862-ad23-63c29c3f4d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.252446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422a887-a988-4862-ad23-63c29c3f4d52 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.253383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422a887-a988-4862-ad23-63c29c3f4d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:12.253905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422a887-a988-4862-ad23-63c29c3f4d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:12.255625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422a887-a988-4862-ad23-63c29c3f4d52 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:12.268904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 387/779] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:12.274051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:12.406933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d04d-72f7-488e-a52a-d280350cf7d9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:12.408267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785e054-a96b-4d88-80eb-10d3e0c76dbe None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.408760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785e054-a96b-4d88-80eb-10d3e0c76dbe None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.409306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785e054-a96b-4d88-80eb-10d3e0c76dbe None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.414811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 388/780] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:12.416197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db751-0fd8-431d-ae47-ec00bed8eb83 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.416691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db751-0fd8-431d-ae47-ec00bed8eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.417689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db751-0fd8-431d-ae47-ec00bed8eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.447853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:12.451400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.451400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.451400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.452191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-180db751-0fd8-431d-ae47-ec00bed8eb83 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:12.453399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-180db751-0fd8-431d-ae47-ec00bed8eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:12.466519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:12.467975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:12.486277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:12.487261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:12.488201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:12.490129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 393/781] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:32:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:12.496371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:12.570430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 389/782] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:12.602416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180db751-0fd8-431d-ae47-ec00bed8eb83 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:12.670388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dedef0-28da-4336-89ee-2ba3877efb7d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:12.715219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:12.715887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.716167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.716439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.717285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:12.717593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:12.719060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:12.737095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 394/783] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 12 11:32:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:12.742482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:12.777372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180db751-0fd8-431d-ae47-ec00bed8eb83 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:12.843077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40535cbb-7b84-4b40-838a-a01de20c7abd None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:12.855872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f183fad-dd7b-4a51-876c-e803007c5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:12.856988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f183fad-dd7b-4a51-876c-e803007c5acd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.857510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f183fad-dd7b-4a51-876c-e803007c5acd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.858020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f183fad-dd7b-4a51-876c-e803007c5acd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.858899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f183fad-dd7b-4a51-876c-e803007c5acd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:12.860494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f183fad-dd7b-4a51-876c-e803007c5acd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-1f183fad-dd7b-4a51-876c-e803007c5acd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:12.874310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:12.875267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:12.876674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 390/784] 10.222.0.58 () {56 vars in 1129 bytes} [Thu May 12 11:32:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:12.877550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822e35-8ce2-42ee-a64e-1150862bf421 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.877550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822e35-8ce2-42ee-a64e-1150862bf421 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.877550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822e35-8ce2-42ee-a64e-1150862bf421 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.879773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 391/785] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:12.882316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae619d-8e9d-4f85-87e7-0e334965da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:12.883105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae619d-8e9d-4f85-87e7-0e334965da64 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.883388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae619d-8e9d-4f85-87e7-0e334965da64 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.883660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae619d-8e9d-4f85-87e7-0e334965da64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.884339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a822e35-8ce2-42ee-a64e-1150862bf421 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:12.895620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae619d-8e9d-4f85-87e7-0e334965da64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:12.897113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae619d-8e9d-4f85-87e7-0e334965da64 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-6cae619d-8e9d-4f85-87e7-0e334965da64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:12.915596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:12.916561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:12.917519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:12.917519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:12.917519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:12.917519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:12.917519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 395/786] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:12.922733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b930dd-d240-4f79-9a2b-75e544ed96d5 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:12.923025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b930dd-d240-4f79-9a2b-75e544ed96d5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:12.923303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b930dd-d240-4f79-9a2b-75e544ed96d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:12.940933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-57b930dd-d240-4f79-9a2b-75e544ed96d5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:12.942142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-57b930dd-d240-4f79-9a2b-75e544ed96d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:13.004634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a822e35-8ce2-42ee-a64e-1150862bf421 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.013722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 396/787] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:13.013722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b930dd-d240-4f79-9a2b-75e544ed96d5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.060433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.061451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.062289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.062777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.064281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:13.064833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.067015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.075846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 392/788] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 12 11:32:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:13.076637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.131878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b930dd-d240-4f79-9a2b-75e544ed96d5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.175499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.176930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.177534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.178113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.179023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:13.179512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.179816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6357752-6132-49a8-b8f4-2569b91454ad None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.181439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.196697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 397/789] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:13.197764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.221013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.222139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.223035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.223498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.237232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:13.247101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:13.248073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:13.248931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:13.255954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 393/790] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:13.255954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.322337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019d0da-9feb-4a4a-9d5b-0d5f332dc64c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.363619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f76223-515a-4033-bbbc-8dd7b9277d1b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.368383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.369312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.369780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.370813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.371679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:13.372158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.374251 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.381809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 398/791] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:13.382770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.404729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.405662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.406116 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.406461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.413648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.415255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:13.431414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:13.433102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:13.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:13.440384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 394/792] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:13.441337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.506050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dccd4-6e30-44f9-a26a-4e93d4631fe5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.542833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.543917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.544521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.545005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.545968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:13.546474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.548041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.554348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a003c-b986-4b63-8495-7208d1c97896 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.561860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 399/793] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:13.563025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.595883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.596469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.596753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.597029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.598060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] RBAC: Adding query filter params (interface=public, service_id=12071b33933b473eb237024625537078, region_id=RegionOne) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:13.599117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.600498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.611218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 395/794] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/endpoints?service_id=12071b33933b473eb237024625537078&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:13.611218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.670250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b1153-f868-40ec-b179-0c3536cdc286 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.707668 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.708700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.709180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.709650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.710660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:13.711180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.712803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.729906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcb646-7cc3-4d1f-a036-2bf994208967 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.730223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 400/795] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:13.731299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.768131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.768916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.769254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.769545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.780145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.781602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:13.798578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:13.799512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:13.800428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:13.800428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:13.800428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:13.800428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:13.804580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 396/796] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:13.805325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.837163 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7b37-a09e-4e39-9a84-e85ee606f575 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.873089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.873803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.874086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.874362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.875045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.876404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:13.885750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 401/797] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:13.885750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:13.913005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51224005-bf8f-471d-935f-fc88aa86dc6f None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:13.953034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11fb3-c04b-457c-8528-772077b93ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:13.954260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11fb3-c04b-457c-8528-772077b93ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:13.954690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11fb3-c04b-457c-8528-772077b93ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:13.955130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11fb3-c04b-457c-8528-772077b93ee9 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/7f0ef19cf7fb4fb2992d5b040fe80190/roles/29b66fdb14844ff6b20ff938a256fd87` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:13.983353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11fb3-c04b-457c-8528-772077b93ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=7f0ef19cf7fb4fb2992d5b040fe80190, role_id=29b66fdb14844ff6b20ff938a256fd87)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:13.985450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11fb3-c04b-457c-8528-772077b93ee9 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.000747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1f9c-ba79-4689-8328-259e95b0a261 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.005530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 397/798] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:32:13 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/7f0ef19cf7fb4fb2992d5b040fe80190/roles/29b66fdb14844ff6b20ff938a256fd87 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:32:14.007289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d463027-0f4d-4df8-bfcf-9f65372a681f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.007793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d463027-0f4d-4df8-bfcf-9f65372a681f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.008223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d463027-0f4d-4df8-bfcf-9f65372a681f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.009984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 398/799] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:14.016215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4337e-4d03-41c0-ad21-068af29b82a5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.016598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4337e-4d03-41c0-ad21-068af29b82a5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.016948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4337e-4d03-41c0-ad21-068af29b82a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.045156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-32b4337e-4d03-41c0-ad21-068af29b82a5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:14.046611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-32b4337e-4d03-41c0-ad21-068af29b82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:14.101746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.102860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.103420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.103897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.104989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:14.105549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:14.107171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.121496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 402/800] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:14.131092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.141624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 399/801] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:14.178309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4337e-4d03-41c0-ad21-068af29b82a5 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.262006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b120-bc8a-46a3-a0d5-6cf476c254c0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.296845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4337e-4d03-41c0-ad21-068af29b82a5 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.310405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.311209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.311489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.311756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.319985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:14.321424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.331585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.332381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.332659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.332932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.345842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:14.348171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:14.349501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:14.350522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 403/802] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:14.359521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:14.362178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:14.364784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 400/803] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:14.366793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.366945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.492357 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436b150-2912-47b1-95eb-87f49762cb4d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.527615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.528292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.528635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.528913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.529748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:14.530055 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:14.531445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.540322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 401/804] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:14.550718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.567702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ddc6-813d-47be-8ca7-27e499e93a62 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.606158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a690-1efa-4b3c-9957-51f3344c7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.606963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a690-1efa-4b3c-9957-51f3344c7c3b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.607249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a690-1efa-4b3c-9957-51f3344c7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.607677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a690-1efa-4b3c-9957-51f3344c7c3b None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.608866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a690-1efa-4b3c-9957-51f3344c7c3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:14.609183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a690-1efa-4b3c-9957-51f3344c7c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:14.611106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a690-1efa-4b3c-9957-51f3344c7c3b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.636386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 404/805] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:14.637842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f9c2f-d831-4a95-87e4-de96c99b8905 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.638134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f9c2f-d831-4a95-87e4-de96c99b8905 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.638411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f9c2f-d831-4a95-87e4-de96c99b8905 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.639952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 405/806] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:14.641242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f9c2f-d831-4a95-87e4-de96c99b8905 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.693010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324a729-3038-4985-8550-19568b6bf293 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.727277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84676de-0899-427c-b200-b738fb8e5817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.728066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84676de-0899-427c-b200-b738fb8e5817 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.728349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84676de-0899-427c-b200-b738fb8e5817 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.728625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84676de-0899-427c-b200-b738fb8e5817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.740091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84676de-0899-427c-b200-b738fb8e5817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:14.741540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84676de-0899-427c-b200-b738fb8e5817 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.751010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f9c2f-d831-4a95-87e4-de96c99b8905 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b84676de-0899-427c-b200-b738fb8e5817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:14.759715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:14.760836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:14.761980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:14.761980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:14.761980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:14.761980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:14.761980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 402/807] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:14.763303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d72e4-ff98-4503-9b27-37f5bddcef60 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.763520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d72e4-ff98-4503-9b27-37f5bddcef60 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.763796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d72e4-ff98-4503-9b27-37f5bddcef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.784865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b96d72e4-ff98-4503-9b27-37f5bddcef60 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:14.786197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b96d72e4-ff98-4503-9b27-37f5bddcef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:14.792273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.793234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.793663 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.794102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.804376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:14.806024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:14.825546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:14.826769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:14.827859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:14.827859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:14.827859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:14.827859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:14.829678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 406/808] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:14.830768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.857317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 403/809] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:14.858380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d72e4-ff98-4503-9b27-37f5bddcef60 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.932393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432095b3-a134-4eec-a703-35201015ca58 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.960232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d72e4-ff98-4503-9b27-37f5bddcef60 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:14.968119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.969006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.969439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.969886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.970778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:14.971249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:14.972769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:14.984568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 407/810] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:14.985717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:14.996585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:14.997257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:14.997591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:14.997916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:14.998645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:14.998953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.000390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.013074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 404/811] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:15.013980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.087441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89e2f-cc58-4b4e-972d-098dc7d1c17d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.112877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb70e6-aa83-46bd-a332-6a45c98ea669 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.120900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.121928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.122421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.122882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] PATH_INFO: `/v3/services/network` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.123713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.125244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:15.137569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:15.138665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 11:32:15.139513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:15.142396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 408/812] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:14 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:15.143385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.147281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.148453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.148453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.148714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.157023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.158559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:15.173292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:15.174284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:15.175233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 405/813] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:15.175822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.248342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797228-454a-4f21-ae16-31e5583eb514 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.276556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d711cb-f2b4-49da-83bf-46d2f4dfddb2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.283902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.285061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.285547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.286046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.294053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.295729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:15.310753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:15.311653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:15.312555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:15.314180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.314895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 409/814] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:15.315119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.315552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.315931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.316269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.316925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] RBAC: Adding query filter params (name=network) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:15.317344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.318921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.325652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 406/815] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:15.326804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.423144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30382-6f54-4d26-80c9-a1e749d7e9e4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.429632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d117f1-82a4-4a43-874a-74796d4faf26 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.459010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.459949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.460379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.460808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.461818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:15.462293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.464454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.468972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.469726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.470089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.470438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.471302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:15.471682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.473178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.485159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 410/816] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:15.486458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.486946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 407/817] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:15.493806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.597574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c2bab-1b3f-4d74-a150-138f2ebd24b3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.619526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292397b4-531b-4e2e-bf3d-2ef994cd20d2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.632249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.632971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.633344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.633865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.662234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afa44-e980-450f-905c-34b189713647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.663573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afa44-e980-450f-905c-34b189713647 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.664330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afa44-e980-450f-905c-34b189713647 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.664792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afa44-e980-450f-905c-34b189713647 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.665687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afa44-e980-450f-905c-34b189713647 None admin] RBAC: Adding query filter params (type=network) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:15.666216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afa44-e980-450f-905c-34b189713647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.669208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afa44-e980-450f-905c-34b189713647 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.675337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 411/818] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:15.676286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afa44-e980-450f-905c-34b189713647 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.707946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.710204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.811383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afa44-e980-450f-905c-34b189713647 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:15.833402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 408/819] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:15.834626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:15.852885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:15.853875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:15.854402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:15.854743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/6754ef93d9344beeae2a5f2812746025/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:15.857761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=6754ef93d9344beeae2a5f2812746025, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:15.859452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:15.881792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 412/820] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:32:15 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/6754ef93d9344beeae2a5f2812746025/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:32:15.884573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:16.015356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a659-9101-429c-8937-6eddce4c146b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.078088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:16.079304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.079811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.080416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.082037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:16.084169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:16.087242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3f51-c5f0-4618-a008-5604a81a3fa7 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.129222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 409/821] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:16.146168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:16.147305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.147740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.148186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.161485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:16.163391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:16.182313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:16.183467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:16.184571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:16.184571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:16.184571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:16.184571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:16.186596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 413/822] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:16.194582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:16.346614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857f9a-4d3d-41d6-a6b3-f7db55c28251 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.390484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5867e-dc36-4b38-95bf-ab075bcf0ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:16.391073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5867e-dc36-4b38-95bf-ab075bcf0ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.391354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5867e-dc36-4b38-95bf-ab075bcf0ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.391624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5867e-dc36-4b38-95bf-ab075bcf0ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.392355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5867e-dc36-4b38-95bf-ab075bcf0ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:16.392659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5867e-dc36-4b38-95bf-ab075bcf0ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:16.394061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5867e-dc36-4b38-95bf-ab075bcf0ff4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:16.406537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 410/823] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:16.412064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:16.465444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52e47-debc-4006-934e-e77eb1de3c87 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.466010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52e47-debc-4006-934e-e77eb1de3c87 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.466010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52e47-debc-4006-934e-e77eb1de3c87 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.468646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 411/824] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:16.479939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c47bfe-ec8a-47a9-b820-cf75b317dfe1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.480564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c47bfe-ec8a-47a9-b820-cf75b317dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.481068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c47bfe-ec8a-47a9-b820-cf75b317dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.514833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-69c47bfe-ec8a-47a9-b820-cf75b317dfe1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:16.516933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-69c47bfe-ec8a-47a9-b820-cf75b317dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:16.566768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d898dd9-630e-471b-b4ea-9d6483f910c5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.601558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 412/825] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:16.602930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434672a-66bb-444c-8c31-2f425943ac91 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.603220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434672a-66bb-444c-8c31-2f425943ac91 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.603497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434672a-66bb-444c-8c31-2f425943ac91 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.605685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 413/826] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:16.611612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e5db-366c-4060-b277-d57c992a7388 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.612009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e5db-366c-4060-b277-d57c992a7388 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.612589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e5db-366c-4060-b277-d57c992a7388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.617872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:16.618852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.620510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.620794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.631213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b490e5db-366c-4060-b277-d57c992a7388 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:16.631464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:16.632531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b490e5db-366c-4060-b277-d57c992a7388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:16.632770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:16.650754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:16.651721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:16.652628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 414/827] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:16.653121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:16.706974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 414/828] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:16.707768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490e5db-366c-4060-b277-d57c992a7388 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:16.762524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c168db-124d-4883-ae6a-25519ef37c37 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.796410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:16.797208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.797488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.797817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.808327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:16.813753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490e5db-366c-4060-b277-d57c992a7388 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:16.816017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:16.816953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:16.817847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 415/829] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:32:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:16.818538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:16.852853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:16.853509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.853825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.854751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.855547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:16.855858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:16.857298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:16.874923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 415/830] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:16.874923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:16.926448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfce87-f016-4c37-85ad-3274616008f6 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.960673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:16.961491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:16.961804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:16.962081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:16.962741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:16.964135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:16.977002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf618-fa7d-41c1-99e9-ede3d7159542 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:16.977417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:16.978561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:16.980033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 416/831] 10.222.0.58 () {56 vars in 1129 bytes} [Thu May 12 11:32:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:16.980885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.015831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.016738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.017186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.017594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.018505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:17.018963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.020316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.029527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 416/832] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:32:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:17.031099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.086255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47acc16-a91b-4653-9bde-b5d35b9c2e47 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.124739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.125673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.125984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.126509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.127335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=59372ef7ca2d439c8a2c12e29f8d97bf) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:17.127642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.128048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a08ad-8685-4284-af07-65db2c42d3e5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.129048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.141994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 417/833] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:16 2022] GET /identity/v3/role_assignments?user.id=59372ef7ca2d439c8a2c12e29f8d97bf&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:17.141994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.163506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.164180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.164464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.164740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.165459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:17.165796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.167236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.172686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 417/834] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 12 11:32:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:17.178527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.272596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e61a-4b96-4b22-8311-54d5099d723a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.303172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95375799-04a9-4289-8806-7f0c8974c348 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.310846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.311650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.311932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.312204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.324081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.325545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.339354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.340023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.340362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.340643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.341355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:17.341663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.343143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:17.343532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:17.344409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:17.345322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:17.345322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:17.345322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:17.345322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:17.345322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 418/835] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:17.352327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 418/836] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 12 11:32:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:17.352533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.362318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.463999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedef489-b13d-4991-884e-e520f50a66bd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.472216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74301-bcb2-4b8d-a1e3-9ddae5832d43 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.501750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.501750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.501750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.501750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.502961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.502961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.514602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.515555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.515896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.516241 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.517035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:17.517408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.518944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.530587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 419/837] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:17.531633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 419/838] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:17.537319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.656958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb84ca5-c8d3-4c6c-bed6-6274d46e7f16 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.694961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.696192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.696671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.697140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.705518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.707328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:17.723302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:17.724238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:17.725175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:17.727468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 420/839] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:32:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:17.734515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:17.838130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c1d4-dda3-406d-9228-c1c0b5ec3ff2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:17.872515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:17.873547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:17.874050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:17.874518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:17.875551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:17.876098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:17.877730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:17.896147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 420/840] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 12 11:32:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:17.902644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.006068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a907d-7eab-4573-8626-a9897a01213e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.040781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62e396-8cee-455b-9fb4-68aa58c664d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.042409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62e396-8cee-455b-9fb4-68aa58c664d5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.042888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62e396-8cee-455b-9fb4-68aa58c664d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.043351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62e396-8cee-455b-9fb4-68aa58c664d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.110968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62e396-8cee-455b-9fb4-68aa58c664d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:18.112795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62e396-8cee-455b-9fb4-68aa58c664d5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:18.215271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 421/841] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:18.220693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.319867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b4484-2604-4a86-bf16-01d7671417bb None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.354491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.355286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.355567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.355841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.366013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:18.367453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:18.373515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8efaef-cb8c-44d5-a76d-1080a7e92148 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.373850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8efaef-cb8c-44d5-a76d-1080a7e92148 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.374134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8efaef-cb8c-44d5-a76d-1080a7e92148 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.376812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 422/842] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:18.380997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da7f60-283f-47a8-bcd6-e0e08708d91f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.381289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da7f60-283f-47a8-bcd6-e0e08708d91f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.381571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da7f60-283f-47a8-bcd6-e0e08708d91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:18.386507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:18.387390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:18.388285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:18.388285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:18.388285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:18.388285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:18.388285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 421/843] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:18.393464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.399233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d2da7f60-283f-47a8-bcd6-e0e08708d91f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:18.400464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d2da7f60-283f-47a8-bcd6-e0e08708d91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:18.477862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 423/844] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:18.496912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da7f60-283f-47a8-bcd6-e0e08708d91f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.508445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789c95b-92f4-4f6f-b1c5-893a250406ff None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.543667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.544667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.545177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.545650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.546616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:18.547124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:18.548704 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:18.561093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 422/845] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:18.570689 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.599690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da7f60-283f-47a8-bcd6-e0e08708d91f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.634951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.635774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.636054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.636326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.646612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:18.654264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:18.655213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:18.656049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 424/846] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:18.664636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.693918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9164f-ca27-461b-a780-2bb426930ba3 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.737185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.738063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.738346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.738622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.747101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:18.749267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:18.767152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:18.768119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:18.769033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 423/847] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:18.774448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.791354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b7a07-90cd-4e33-8195-b656037e7f84 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.829907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.830505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.830791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.831071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.831884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:18.832194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:18.833625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:18.847301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 425/848] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:18.848588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.881683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a86ea-992d-4186-8a45-5cc3440ae452 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.917095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.917797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.918084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.918358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:18.919152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:18.919463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:18.920884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:18.936371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 424/849] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:18.940158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:18.952726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c82516-9b0f-4788-8184-00737f8e4ae8 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:18.988875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:18.989664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:18.989988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:18.990263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.001459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.003029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:19.021042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:19.023169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:19.025224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:19.025224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:19.025224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:19.025224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:19.028724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 426/850] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:19.028724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:19.053317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baddbdc-a17a-4fee-a744-76b71bc1a789 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:19.101099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:19.101797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.102082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.102355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.103192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=7f0ef19cf7fb4fb2992d5b040fe80190) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:19.103502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.105941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:19.117814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 425/851] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:18 2022] GET /identity/v3/role_assignments?user.id=7f0ef19cf7fb4fb2992d5b040fe80190&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:19.138514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0abda7-6c82-469d-aa95-d6e03b4adf9a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:19.175166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:19.175837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.176120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.176396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.177133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:19.177439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.178880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:19.197227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 427/852] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:19.199864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:19.312924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118274e7-7130-4b51-8719-b1e1d5c84d1d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:19.349242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:19.350073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.350406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.350685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.360410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.361863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:19.380014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:19.382233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:19.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 426/853] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:19.387773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:19.495639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5255f-0d70-40ce-890e-3dad46409bda None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:19.530755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd364fa2-b188-4254-87a0-5c4027c19254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:19.531435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364fa2-b188-4254-87a0-5c4027c19254 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.531712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364fa2-b188-4254-87a0-5c4027c19254 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.531985 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364fa2-b188-4254-87a0-5c4027c19254 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.532831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd364fa2-b188-4254-87a0-5c4027c19254 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:19.533138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd364fa2-b188-4254-87a0-5c4027c19254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.534595 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd364fa2-b188-4254-87a0-5c4027c19254 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:19.553096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 428/854] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 12 11:32:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:19.558864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:19.569043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86c49-ebf0-4120-b2c2-f1f464907670 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.569599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86c49-ebf0-4120-b2c2-f1f464907670 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.569912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86c49-ebf0-4120-b2c2-f1f464907670 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.571493 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 429/855] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:19.576329 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c1a9-d17a-42ba-ae1c-f3b2c947763b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.576612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c1a9-d17a-42ba-ae1c-f3b2c947763b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.576890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c1a9-d17a-42ba-ae1c-f3b2c947763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.593695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-4c45c1a9-d17a-42ba-ae1c-f3b2c947763b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:19.594962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4c45c1a9-d17a-42ba-ae1c-f3b2c947763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:19.662322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9808c0-6ab3-4b82-857a-8c03390a75df None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:19.669772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 430/856] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:19.684302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45c1a9-d17a-42ba-ae1c-f3b2c947763b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:19.697241 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e131c84-6922-4f5b-aa12-e198fc64335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:19.697970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e131c84-6922-4f5b-aa12-e198fc64335c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.698256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e131c84-6922-4f5b-aa12-e198fc64335c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.698536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e131c84-6922-4f5b-aa12-e198fc64335c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.774672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e131c84-6922-4f5b-aa12-e198fc64335c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.776476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e131c84-6922-4f5b-aa12-e198fc64335c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:19.789569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45c1a9-d17a-42ba-ae1c-f3b2c947763b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:19.824902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:19.825728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.826033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.826308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.826961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.828328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:19.840354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:19.842499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:19.844424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:19.846263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 431/857] 10.222.0.58 () {56 vars in 1132 bytes} [Thu May 12 11:32:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:19.849804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:19.897812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 427/858] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:19.899454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac132f0c-918f-44aa-9f17-2d95fe66d37a None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.899892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac132f0c-918f-44aa-9f17-2d95fe66d37a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.900181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac132f0c-918f-44aa-9f17-2d95fe66d37a None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.901926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 428/859] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:19.902504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac132f0c-918f-44aa-9f17-2d95fe66d37a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:19.958015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c55edf-cc96-4835-824d-9ebc1f94e7e3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:19.992894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef8e90-4efc-4c0d-a6ca-38eae3aa2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:19.993556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8e90-4efc-4c0d-a6ca-38eae3aa2fab None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:19.993869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8e90-4efc-4c0d-a6ca-38eae3aa2fab None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:19.994143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8e90-4efc-4c0d-a6ca-38eae3aa2fab None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:19.995485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef8e90-4efc-4c0d-a6ca-38eae3aa2fab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:19.995794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef8e90-4efc-4c0d-a6ca-38eae3aa2fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:19.997171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef8e90-4efc-4c0d-a6ca-38eae3aa2fab None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.006080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 432/860] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:20.006080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84291-2835-4f8e-b340-a7bd780ed041 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.006080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84291-2835-4f8e-b340-a7bd780ed041 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.006080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84291-2835-4f8e-b340-a7bd780ed041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.020258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-05b84291-2835-4f8e-b340-a7bd780ed041 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:20.021427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-05b84291-2835-4f8e-b340-a7bd780ed041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:20.027542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac132f0c-918f-44aa-9f17-2d95fe66d37a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.061126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.061946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.062234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.062513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.072582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.074099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.089621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 433/861] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:20.090840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b84291-2835-4f8e-b340-a7bd780ed041 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:20.091236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:20.092193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:20.093107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:20.093107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:20.093107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:20.093107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:20.097308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 429/862] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:20.098229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.197164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba477a1-d8bd-4648-9cd7-cb5fb6b02a82 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.199519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b84291-2835-4f8e-b340-a7bd780ed041 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.230421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.231103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.231386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.231661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.232372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:20.232675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.233493 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.234051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.234167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.234452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.234730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.235435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:20.235741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.237108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.241615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 434/863] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:20.249777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 430/864] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:20.249972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.250694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.365040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa95db-0010-4a46-9ba1-6af3419c9415 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.373918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d91b4-274a-49c6-b037-08f9a3785d2a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.404613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.405827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.406322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.406828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.407699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.409691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.411493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.412401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.412740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.413080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.421517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.423222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:20.425162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:20.426169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:20.427017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:20.429996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 435/865] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:20.436569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:20.439611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:20.440510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:20.443366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 431/866] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:20.446996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.553094 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393de84-1705-49d6-917e-b81470b6f60e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.572497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7153-1e47-4f61-b2b3-2553eab5709c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.595618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.597196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.597687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.598340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.599927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:20.600446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.602841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.606941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.607681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.608038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.608386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.609164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:20.609540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.611047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.623531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 436/868] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:20.623531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.623976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 432/868] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:20.625456 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:20.729982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84280f2-fdac-43df-b129-da2a0640be58 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.739886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ff04-b18d-4498-8f9a-04a697659a00 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:20.764896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1c860-b940-4b1f-98b9-cdd472b54c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.765581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1c860-b940-4b1f-98b9-cdd472b54c06 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.765990 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1c860-b940-4b1f-98b9-cdd472b54c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.766379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1c860-b940-4b1f-98b9-cdd472b54c06 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.767189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1c860-b940-4b1f-98b9-cdd472b54c06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:20.767597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1c860-b940-4b1f-98b9-cdd472b54c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.769068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1c860-b940-4b1f-98b9-cdd472b54c06 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.777882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 437/869] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:20.783743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cf5ea-c3c5-4294-afb2-e230e6987178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:20.785017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf5ea-c3c5-4294-afb2-e230e6987178 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:20.785469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf5ea-c3c5-4294-afb2-e230e6987178 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:20.785936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf5ea-c3c5-4294-afb2-e230e6987178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:20.786963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cf5ea-c3c5-4294-afb2-e230e6987178 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=6754ef93d9344beeae2a5f2812746025) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:20.787430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cf5ea-c3c5-4294-afb2-e230e6987178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:20.789067 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cf5ea-c3c5-4294-afb2-e230e6987178 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:20.797402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 433/870] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:20 2022] GET /identity/v3/role_assignments?user.id=6754ef93d9344beeae2a5f2812746025&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:21.546104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638285-ca70-4b60-99b5-4edd6698fe96 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:21.546431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638285-ca70-4b60-99b5-4edd6698fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:21.546669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638285-ca70-4b60-99b5-4edd6698fe96 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:21.548263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 438/871] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:21.553798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28192c-545c-4af3-a9cb-e7cd5acb7e05 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:21.554089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28192c-545c-4af3-a9cb-e7cd5acb7e05 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:21.554363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28192c-545c-4af3-a9cb-e7cd5acb7e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:21.571913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-5c28192c-545c-4af3-a9cb-e7cd5acb7e05 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:21.573141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5c28192c-545c-4af3-a9cb-e7cd5acb7e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:21.639074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 434/872] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:21.662247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638285-ca70-4b60-99b5-4edd6698fe96 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:21.767185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638285-ca70-4b60-99b5-4edd6698fe96 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:21.801582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:21.802414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:21.802698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:21.802973 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:21.813003 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:21.821367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:21.822395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:21.823962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 439/873] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 12 11:32:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:21.828517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28192c-545c-4af3-a9cb-e7cd5acb7e05 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:21.929660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28192c-545c-4af3-a9cb-e7cd5acb7e05 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:21.967590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:21.968262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:21.968542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:21.968817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:21.969567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:21.969902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:21.971257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:21.980497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 435/874] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 12 11:32:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:21.985909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:22.090724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275acd-cfc5-4ec6-93bd-f1ba337a5602 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:22.125926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:22.126723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.127004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.127277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.146737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:22.148261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:22.165527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:22.168066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:22.169342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:22.169342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:22.169342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:22.169342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:22.169342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 440/875] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:22.172997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:22.274390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbdba4-8714-4d5a-9ee7-ddc19befc51e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:22.308200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:22.309226 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.309735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.310217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.311185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:22.311693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:22.313280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:22.327369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 436/876] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:22.335929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:22.436998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c1059-0194-43d8-a8e8-fbeeebf0af61 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:22.471850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae5846-6a69-4f4d-8c70-4ca29c765131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:22.472656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5846-6a69-4f4d-8c70-4ca29c765131 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.472934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5846-6a69-4f4d-8c70-4ca29c765131 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.473200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5846-6a69-4f4d-8c70-4ca29c765131 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.480694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae5846-6a69-4f4d-8c70-4ca29c765131 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:22.482165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae5846-6a69-4f4d-8c70-4ca29c765131 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-bbae5846-6a69-4f4d-8c70-4ca29c765131 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:22.497086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:22.498144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:22.499089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 441/877] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:32:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:22.504222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:22.605368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1b969-779b-4a5c-acde-7ec3a445f71f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.605843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1b969-779b-4a5c-acde-7ec3a445f71f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.606125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1b969-779b-4a5c-acde-7ec3a445f71f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.608361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 442/878] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:22.610073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a72b0-ca2b-45b6-8b04-bc1f47f62a1a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:22.614462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911fb9-1f90-4c23-8b46-44507de8a1ed None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.614749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911fb9-1f90-4c23-8b46-44507de8a1ed None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.615026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911fb9-1f90-4c23-8b46-44507de8a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.635446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-aa911fb9-1f90-4c23-8b46-44507de8a1ed None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:22.637265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-aa911fb9-1f90-4c23-8b46-44507de8a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:22.649025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:22.650359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.651658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.652165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.653381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:22.654291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:22.656380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:22.679732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 437/879] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 12 11:32:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:22.690542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:22.737808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 443/880] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:22.757570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa911fb9-1f90-4c23-8b46-44507de8a1ed None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:22.803441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae382-b5e3-47e3-99cf-cce30e2da847 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:22.838821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a413b-1dd1-403f-bfc2-f64aa9e43d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:22.839498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a413b-1dd1-403f-bfc2-f64aa9e43d2b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.839764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a413b-1dd1-403f-bfc2-f64aa9e43d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.840398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a413b-1dd1-403f-bfc2-f64aa9e43d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.874923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa911fb9-1f90-4c23-8b46-44507de8a1ed None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:22.908203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a413b-1dd1-403f-bfc2-f64aa9e43d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:22.909686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a413b-1dd1-403f-bfc2-f64aa9e43d2b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:22.910427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:22.911253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:22.911682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:22.912103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:22.912988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:22.914540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:22.930579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 444/881] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:22 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:32:23.028035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 438/882] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:23.033674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.136398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baf585-9aed-486a-af34-f54ea9a00288 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.136725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baf585-9aed-486a-af34-f54ea9a00288 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.136965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baf585-9aed-486a-af34-f54ea9a00288 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.142246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 439/883] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:23.147430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45658938-4cfd-424e-bbbd-0be12c5b6499 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.147726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45658938-4cfd-424e-bbbd-0be12c5b6499 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.148005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45658938-4cfd-424e-bbbd-0be12c5b6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.153036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f785a-f999-48c7-b0bd-5fefdb714d18 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.169912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-45658938-4cfd-424e-bbbd-0be12c5b6499 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:23.171167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-45658938-4cfd-424e-bbbd-0be12c5b6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:23.190704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c184d3f-f61a-48b4-bb37-966929494520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.191503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184d3f-f61a-48b4-bb37-966929494520 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.191785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184d3f-f61a-48b4-bb37-966929494520 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.192057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184d3f-f61a-48b4-bb37-966929494520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.203873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c184d3f-f61a-48b4-bb37-966929494520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.205328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c184d3f-f61a-48b4-bb37-966929494520 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-3c184d3f-f61a-48b4-bb37-966929494520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:23.223569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:23.224518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:23.225520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:23.225520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:23.225520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:23.225520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:23.227430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 445/884] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:23.228658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec1630-9c39-4272-aabf-1e269f2d2690 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.228963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec1630-9c39-4272-aabf-1e269f2d2690 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.229233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec1630-9c39-4272-aabf-1e269f2d2690 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.230534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 446/885] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:23.232937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec1630-9c39-4272-aabf-1e269f2d2690 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.246980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 440/886] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:23 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:23.255108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fba89-7304-494c-a473-45a42ade56fa None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.255651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fba89-7304-494c-a473-45a42ade56fa None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.255651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fba89-7304-494c-a473-45a42ade56fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.276100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-252fba89-7304-494c-a473-45a42ade56fa None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:23.277286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-252fba89-7304-494c-a473-45a42ade56fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:23.337551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec1630-9c39-4272-aabf-1e269f2d2690 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.344388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 441/887] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:23 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:23.349775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fba89-7304-494c-a473-45a42ade56fa None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.374002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.374667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.375215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.375215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.375927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:23.376234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.377598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.393814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 447/888] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:23.394498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.454058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fba89-7304-494c-a473-45a42ade56fa None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.489370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.490204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.490484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.490761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.491415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.492776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.504475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dbe43-3a65-498e-87fb-4018152670e6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:23.504671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:23.505622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:23.506540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 442/889] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:23.507978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.543287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.543950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.544234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.544510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.545287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.546762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.561553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 448/890] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:23 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:23.562385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.671202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe8b3-776f-4d79-8bb8-485cae72ef47 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.677539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497d4ad-3541-48db-8583-9e049caea695 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.709146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.710366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.710859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.711364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.716620 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.717507 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.717834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.718112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.718909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:23.719217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.720673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.722327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.724086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.731067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 449/891] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:23.732052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:23.740356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:23.741335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:23.742275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:23.744519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 443/892] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:23.750398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:23.853603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b102-3d09-4e1f-8689-e1d159b90364 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.860364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e2391-1c15-47a7-9a25-aaf671d2bcd9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:23.889841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.891251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.891831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.892387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.893453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:23.894082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.895240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab56ff6-bec3-48e0-a672-7f31481efd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:23.895983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab56ff6-bec3-48e0-a672-7f31481efd92 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:23.896333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab56ff6-bec3-48e0-a672-7f31481efd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:23.896590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.896691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab56ff6-bec3-48e0-a672-7f31481efd92 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:23.897525 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab56ff6-bec3-48e0-a672-7f31481efd92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:23.897869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab56ff6-bec3-48e0-a672-7f31481efd92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:23.899468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab56ff6-bec3-48e0-a672-7f31481efd92 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:23.902963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 450/893] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:23.920681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 444/894] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:23.927068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:24.039118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc4a4-0282-4428-98d7-85996277e6f0 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:24.077312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb745e-4944-4b26-8e0b-b69e91da0e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:24.078302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb745e-4944-4b26-8e0b-b69e91da0e26 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:24.078736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb745e-4944-4b26-8e0b-b69e91da0e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:24.079169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb745e-4944-4b26-8e0b-b69e91da0e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:24.080166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb745e-4944-4b26-8e0b-b69e91da0e26 None admin] RBAC: Adding query filter params (role.id=f19dfea272f648fbb29eb721f2974dfa, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=7f0ef19cf7fb4fb2992d5b040fe80190) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:24.080651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb745e-4944-4b26-8e0b-b69e91da0e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:24.082290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb745e-4944-4b26-8e0b-b69e91da0e26 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:24.088978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 451/895] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:23 2022] GET /identity/v3/role_assignments?user.id=7f0ef19cf7fb4fb2992d5b040fe80190&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=f19dfea272f648fbb29eb721f2974dfa => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:25.276334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b909b7f-8f3a-4e69-a0a4-8f46ed35621c None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:25.276957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b909b7f-8f3a-4e69-a0a4-8f46ed35621c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:25.276957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b909b7f-8f3a-4e69-a0a4-8f46ed35621c None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:25.278409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 445/896] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:25.283926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cfbaf-fe5f-426c-9586-316432f4532b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:25.284742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cfbaf-fe5f-426c-9586-316432f4532b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:25.285234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cfbaf-fe5f-426c-9586-316432f4532b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:25.302712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-875cfbaf-fe5f-426c-9586-316432f4532b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:25.304232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-875cfbaf-fe5f-426c-9586-316432f4532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:25.381855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 452/897] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:25.399317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b909b7f-8f3a-4e69-a0a4-8f46ed35621c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:25.513386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b909b7f-8f3a-4e69-a0a4-8f46ed35621c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:25.546347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:25.547077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:25.547354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:25.547621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:25.548336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:25.549733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:25.562805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:25.563875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:25.564812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 446/898] 10.222.0.58 () {56 vars in 1132 bytes} [Thu May 12 11:32:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:25.570464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cfbaf-fe5f-426c-9586-316432f4532b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:25.671186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cfbaf-fe5f-426c-9586-316432f4532b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:25.705310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:25.708999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:25.708999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:25.708999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:25.708999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:25.708999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:25.708999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:25.714582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 453/899] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:25.720252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:25.825353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b4881-c350-43d0-8aa9-986e1cca3600 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:25.861783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:25.862445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:25.862738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:25.863040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:25.863749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:25.864050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:25.865405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:25.870711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 447/900] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:25.876647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:25.977131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb4108-ef4c-4a15-beed-30d019bc54ec None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:26.020943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6b84-753f-44e0-83e5-ff5340e9ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:26.021606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6b84-753f-44e0-83e5-ff5340e9ad66 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.021921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6b84-753f-44e0-83e5-ff5340e9ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.022196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6b84-753f-44e0-83e5-ff5340e9ad66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.022994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6b84-753f-44e0-83e5-ff5340e9ad66 None admin] RBAC: Adding query filter params (interface=public, service_id=de77dbf562204db6a7da4e9f10f78175, region_id=RegionOne) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:26.023304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6b84-753f-44e0-83e5-ff5340e9ad66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:26.024669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6b84-753f-44e0-83e5-ff5340e9ad66 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:26.030951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 454/901] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:32:25 2022] GET /identity/v3/endpoints?service_id=de77dbf562204db6a7da4e9f10f78175&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:26.036483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.047986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5095a7-8958-489e-94d9-4de87b8d713a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.048288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5095a7-8958-489e-94d9-4de87b8d713a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.048553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5095a7-8958-489e-94d9-4de87b8d713a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.050097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 455/902] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:26.054967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559487-6cec-4a68-9e5b-1a1e9dbae56a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.055258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559487-6cec-4a68-9e5b-1a1e9dbae56a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.055540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559487-6cec-4a68-9e5b-1a1e9dbae56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.072316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b2559487-6cec-4a68-9e5b-1a1e9dbae56a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:26.074060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b2559487-6cec-4a68-9e5b-1a1e9dbae56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:26.148964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b72ec-e2a4-4de4-aa2e-6a9b327b142e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:26.161973 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 456/903] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:26.171289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd8f38-137a-4a7a-a2c0-d8992bc33db9 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.171574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd8f38-137a-4a7a-a2c0-d8992bc33db9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.171845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd8f38-137a-4a7a-a2c0-d8992bc33db9 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.173406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 457/904] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:26.178456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715f94-012d-4548-b9e4-6a3e6aa97b7a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.178666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715f94-012d-4548-b9e4-6a3e6aa97b7a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.178940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715f94-012d-4548-b9e4-6a3e6aa97b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.188595 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:26.189255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.189534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.189835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.190513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:26.191857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:26.196084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-57715f94-012d-4548-b9e4-6a3e6aa97b7a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:26.197259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-57715f94-012d-4548-b9e4-6a3e6aa97b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:26.206103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 448/905] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:26 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:32:26.206103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.276731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 458/906] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:26.300409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57715f94-012d-4548-b9e4-6a3e6aa97b7a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.332205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379975b-6760-4c6b-9418-3febe7b7b3f6 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:26.370068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:26.370933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.371216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.371491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.372160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:26.373556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:26.386276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:26.387388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:26.389358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:26.393755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 449/907] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:26.395460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.410468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57715f94-012d-4548-b9e4-6a3e6aa97b7a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:26.452291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efae417-4098-43e3-975a-a4dc8773231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:26.453295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efae417-4098-43e3-975a-a4dc8773231d None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.453580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efae417-4098-43e3-975a-a4dc8773231d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.453894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efae417-4098-43e3-975a-a4dc8773231d None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.454634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efae417-4098-43e3-975a-a4dc8773231d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:26.456014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efae417-4098-43e3-975a-a4dc8773231d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:26.471771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 459/908] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:26 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:32:26.507322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35fb3-005e-44ca-a48b-dc98c61c748a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.507661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35fb3-005e-44ca-a48b-dc98c61c748a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.507877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35fb3-005e-44ca-a48b-dc98c61c748a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.509622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 460/909] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:26.515926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851b46-137b-43a8-bc00-a4a24740c936 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.516247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851b46-137b-43a8-bc00-a4a24740c936 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.516480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851b46-137b-43a8-bc00-a4a24740c936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.529635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974237-f70d-4a61-ba00-58df953b1e16 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:26.534712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-90851b46-137b-43a8-bc00-a4a24740c936 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:26.535921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-90851b46-137b-43a8-bc00-a4a24740c936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:26.575479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:26.576234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.576588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.576866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.577648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:26.577998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:26.579407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:26.585414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 450/910] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:26.591673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.617938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 461/911] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:26.650465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851b46-137b-43a8-bc00-a4a24740c936 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.711857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478e00-32e9-4414-8f86-d49b0da38831 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:26.748675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68995f73-7455-44c3-9971-defde35b904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:26.750480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995f73-7455-44c3-9971-defde35b904e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.750973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995f73-7455-44c3-9971-defde35b904e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.752153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995f73-7455-44c3-9971-defde35b904e None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.753101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68995f73-7455-44c3-9971-defde35b904e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:26.753625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68995f73-7455-44c3-9971-defde35b904e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:26.755361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68995f73-7455-44c3-9971-defde35b904e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:26.762685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 451/912] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:26.769125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68995f73-7455-44c3-9971-defde35b904e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.813358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851b46-137b-43a8-bc00-a4a24740c936 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:26.868286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:26.869106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:26.869391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:26.870280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:26.884678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:26.898477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:26.899479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:26.900360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:26.902573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 462/913] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 12 11:32:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:26.905837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:26.982872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68995f73-7455-44c3-9971-defde35b904e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:27.050485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:27.051191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:27.051473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:27.051749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:27.052555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] RBAC: Adding query filter params (interface=public, service_id=468c2a2d2e644830b82575d4501c64a0, region_id=RegionOne) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:27.054038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:27.055422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:27.068214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b2cd8-3e1f-42ae-ad13-75156d3a0aee None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:27.082112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 452/914] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:32:26 2022] GET /identity/v3/endpoints?service_id=468c2a2d2e644830b82575d4501c64a0&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:27.082807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:27.132951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:27.132951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:27.132951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:27.132951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:27.133437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:27.133437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:27.133437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:27.145298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 463/915] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 12 11:32:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:27.150693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:27.210146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f7b9-7190-4526-ad75-8e433c3fb25c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:27.245902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:27.246567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:27.246843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:27.247117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:27.247782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:27.249128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:27.255216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 453/916] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:27 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:32:27.263354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5924d33-3a2d-4e22-98e0-48ee229d17a1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:27.302702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:27.304308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:27.304767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:27.305220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:27.318363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:27.320501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:27.340935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:27.341982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:27.342892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:27.342892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:27.342892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:27.342892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:27.345104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 464/917] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:27.350586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:27.468770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630908d5-449b-4dd8-9758-73ac639af151 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:27.508093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:27.508942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:27.509363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:27.509820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:27.511215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:27.511659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:27.513144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:27.525373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 454/918] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:27.531274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:27.631178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da758c62-742b-4df0-856a-d6e77befee3c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:27.665327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:27.667017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:27.667456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:27.667884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:27.675867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:27.677477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:27.692841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:27.694057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:27.695505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:27.697750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 465/919] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:32:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:27.703893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:27.802511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a194-b4d1-4009-89ff-f3ed860cf920 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:27.843274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:27.844344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:27.844344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:27.844529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:27.845730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:27.845730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:27.849727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:27.865305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 455/920] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 12 11:32:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:27.870655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:27.974188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaf710-5ba9-44b8-a067-65f9d306ffe4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:28.008182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:28.008966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.009244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.009516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.020589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:28.022068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:28.038722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:28.039635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:28.040614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:28.040614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:28.040614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:28.040614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:28.040614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 466/921] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:28.045936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:28.147940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e170-4fb5-450e-aebf-efa20cf24763 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:28.183569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:28.184605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.185120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.185658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.186604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:28.187203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:28.188816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:28.201330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 456/922] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:28.206561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:28.304529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f5365-cfbb-49d1-9489-2a707848ef1b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:28.339242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:28.340027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.340305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.340576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.347409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:28.348853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:28.362632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:28.363546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:28.364442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 467/923] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:28.370373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:28.478747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb251ab-f974-49dc-a0d5-98c71840a184 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:28.516053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c025469-5c16-44fa-8b8e-88db678e2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:28.516723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c025469-5c16-44fa-8b8e-88db678e2901 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.517005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c025469-5c16-44fa-8b8e-88db678e2901 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.517279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c025469-5c16-44fa-8b8e-88db678e2901 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.518111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c025469-5c16-44fa-8b8e-88db678e2901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:28.518419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c025469-5c16-44fa-8b8e-88db678e2901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:28.519847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c025469-5c16-44fa-8b8e-88db678e2901 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:28.532674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 457/924] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:28.538279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:28.641916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec09dc-13b9-4d42-9df9-d3ed6629e1bc None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:28.645729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfe353-4864-4827-95d5-a8a0e13d74aa None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.646261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfe353-4864-4827-95d5-a8a0e13d74aa None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.646732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfe353-4864-4827-95d5-a8a0e13d74aa None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.652599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 458/925] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:28.654295 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fa33-e72a-4f81-aa64-d6445a75d6b1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.654794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fa33-e72a-4f81-aa64-d6445a75d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.655263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269fa33-e72a-4f81-aa64-d6445a75d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.675367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9269fa33-e72a-4f81-aa64-d6445a75d6b1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:28.676566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9269fa33-e72a-4f81-aa64-d6445a75d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:28.680007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:28.681205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.681678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.682210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/7f0ef19cf7fb4fb2992d5b040fe80190/roles/f19dfea272f648fbb29eb721f2974dfa` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.684702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=7f0ef19cf7fb4fb2992d5b040fe80190, role_id=f19dfea272f648fbb29eb721f2974dfa)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:28.686389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:28.704014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 468/926] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:32:28 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/7f0ef19cf7fb4fb2992d5b040fe80190/roles/f19dfea272f648fbb29eb721f2974dfa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:32:28.764087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 459/927] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:28.787202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:28.897596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b254-cf61-4b4e-a292-4d441e11e76a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:28.923813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7545fe-3b80-4c89-9484-696c9d87dca8 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.924153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7545fe-3b80-4c89-9484-696c9d87dca8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.924377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7545fe-3b80-4c89-9484-696c9d87dca8 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.927115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 460/928] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:28.932315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b6fd-55e3-48d4-8d26-578fc2a4af0d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.932691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b6fd-55e3-48d4-8d26-578fc2a4af0d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.932966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b6fd-55e3-48d4-8d26-578fc2a4af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.933068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:28.933833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:28.934155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:28.934536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:28.935207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:28.936629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:28.949812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:28.950797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:28.951627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 469/929] 10.222.0.58 () {56 vars in 1132 bytes} [Thu May 12 11:32:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:28.954044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ee03b6fd-55e3-48d4-8d26-578fc2a4af0d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:28.955146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ee03b6fd-55e3-48d4-8d26-578fc2a4af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:28.957073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.025826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 461/930] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:29.048740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b6fd-55e3-48d4-8d26-578fc2a4af0d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.081049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2057-1a0c-454c-ad6b-9c73c1b1256c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.114723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.115385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.115661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.115931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.116634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:29.116935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.118321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.128461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 470/931] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:29.129566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.154434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b6fd-55e3-48d4-8d26-578fc2a4af0d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.190501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.191680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.192221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.192698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.193562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.195445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:29.208184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:29.209262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:29.210175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:29.218410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 462/932] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:29.219605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.229851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376cacf-bdde-44e9-88e3-f32fe087b12c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.262780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.263548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.263753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.263988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.264691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:29.264991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.266375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.276809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 471/933] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:29.277880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.325963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca097b-fc19-4d3a-8c0c-2d411bc0821c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.361390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.362430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.362978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.363504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.364438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:29.364958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.366545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.377097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 463/934] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:29.377678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7c783-a8f0-4520-963d-70afe462370b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.379172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.412797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.413399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.413684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.413979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.414713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.416124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.453860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 472/935] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:32:29.511625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195e58a-41b6-462e-ba2a-402a3659b220 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.555342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7459b4-93f0-4ea5-83a5-712d4874161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.555935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7459b4-93f0-4ea5-83a5-712d4874161b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.556217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7459b4-93f0-4ea5-83a5-712d4874161b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.556492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7459b4-93f0-4ea5-83a5-712d4874161b None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.557786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7459b4-93f0-4ea5-83a5-712d4874161b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:29.558159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7459b4-93f0-4ea5-83a5-712d4874161b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.559564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7459b4-93f0-4ea5-83a5-712d4874161b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.565892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 464/936] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:29.572006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.670203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c358d-14ba-454c-a7dc-57754f85a890 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.670520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c358d-14ba-454c-a7dc-57754f85a890 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.670759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c358d-14ba-454c-a7dc-57754f85a890 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.672106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 465/937] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:29.677170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae285836-0c01-4d5b-8dc3-54b86b16393e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.678609 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae285836-0c01-4d5b-8dc3-54b86b16393e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.678609 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae285836-0c01-4d5b-8dc3-54b86b16393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.685267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235bc1-970c-4b0d-bfb5-1995ccc1ea14 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.696735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ae285836-0c01-4d5b-8dc3-54b86b16393e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:29.698757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ae285836-0c01-4d5b-8dc3-54b86b16393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:29.724297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.725018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.725301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.725572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.726396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] RBAC: Adding query filter params (interface=public, service_id=fb9562c910cf43c19bd727f0dee34563, region_id=RegionOne) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:29.726708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.728074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.738507 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 473/938] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/endpoints?service_id=fb9562c910cf43c19bd727f0dee34563&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:29.738780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.783255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 466/939] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:29.806053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae285836-0c01-4d5b-8dc3-54b86b16393e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:29.852216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c57415-a8e0-4a7d-91c8-304088f7c9c7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.890078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.891096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.891602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.892076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.892971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.894624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.906115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 474/940] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:32:29.929086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae285836-0c01-4d5b-8dc3-54b86b16393e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:29.968672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:29.969489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:29.969812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:29.970092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:29.970761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:29.972172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:29.985794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:29.986858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:29.987703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 467/941] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:29.995995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:30.118194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0204716-5b5e-4740-bcf6-4c9402ed0e64 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:30.151836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:30.152859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:30.153349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:30.153877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:30.154789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:30.155313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:30.156919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:30.162261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 475/942] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:30.168698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:30.268842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab8040-c42b-4362-b479-83f04399c3a7 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:30.303105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745b8f9-d63b-41de-8fe3-265c28cac3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:30.304202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745b8f9-d63b-41de-8fe3-265c28cac3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:30.304689 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745b8f9-d63b-41de-8fe3-265c28cac3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:30.305165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745b8f9-d63b-41de-8fe3-265c28cac3b4 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:30.306130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745b8f9-d63b-41de-8fe3-265c28cac3b4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:30.306641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745b8f9-d63b-41de-8fe3-265c28cac3b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:30.308259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745b8f9-d63b-41de-8fe3-265c28cac3b4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:30.313573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 468/943] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 12 11:32:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:30.323574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:30.437783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39393d-4be2-46c5-9c6d-a4ce91a4ea7a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:30.472738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087f40c-fb66-4ebb-a6b5-9d48ea39e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:30.473676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087f40c-fb66-4ebb-a6b5-9d48ea39e7e3 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:30.474134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087f40c-fb66-4ebb-a6b5-9d48ea39e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:30.474557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087f40c-fb66-4ebb-a6b5-9d48ea39e7e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:30.475468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087f40c-fb66-4ebb-a6b5-9d48ea39e7e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:30.476989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087f40c-fb66-4ebb-a6b5-9d48ea39e7e3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:30.505898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 476/944] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:31.016170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e88ea9-dd6e-4c11-aff2-3878b414c6d7 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.016691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e88ea9-dd6e-4c11-aff2-3878b414c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.016796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e88ea9-dd6e-4c11-aff2-3878b414c6d7 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.018332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 469/945] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:31.023825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7984e4e-fb5a-4fa3-bb4a-69d8520cf150 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.024120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7984e4e-fb5a-4fa3-bb4a-69d8520cf150 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.024405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7984e4e-fb5a-4fa3-bb4a-69d8520cf150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.042118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a7984e4e-fb5a-4fa3-bb4a-69d8520cf150 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:31.043316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a7984e4e-fb5a-4fa3-bb4a-69d8520cf150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:31.118197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 477/946] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:31.141393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e88ea9-dd6e-4c11-aff2-3878b414c6d7 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:31.248045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e88ea9-dd6e-4c11-aff2-3878b414c6d7 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:31.281610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:31.282374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.282693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.282932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.294466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:31.302582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:31.303517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:31.304599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 470/947] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 12 11:32:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:31.310239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7984e4e-fb5a-4fa3-bb4a-69d8520cf150 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:31.411717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7984e4e-fb5a-4fa3-bb4a-69d8520cf150 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:31.457282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:31.459069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.459362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.459642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.460405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:31.460712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:31.463931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:31.474685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 478/948] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 12 11:32:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:31.484252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:31.588672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db935-fb14-4831-bbb0-0e9afd27d775 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:31.622166 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:31.622954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.623231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.623501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.633525 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:31.634982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:31.653086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:31.654075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:31.654975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:31.654975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:31.654975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:31.654975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:31.654975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 471/949] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:31.661426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:31.773494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae9459-1e38-4789-a2ba-193a3ef09756 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:31.812680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1eb16-1cb3-4a65-b8e6-34b5059e5937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:31.813347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1eb16-1cb3-4a65-b8e6-34b5059e5937 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.813631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1eb16-1cb3-4a65-b8e6-34b5059e5937 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.813943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1eb16-1cb3-4a65-b8e6-34b5059e5937 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.814679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1eb16-1cb3-4a65-b8e6-34b5059e5937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:31.814988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1eb16-1cb3-4a65-b8e6-34b5059e5937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:31.816354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1eb16-1cb3-4a65-b8e6-34b5059e5937 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:31.829631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 479/950] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:31.835181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:31.894014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05de43-64a2-4b9e-800b-d144e1937565 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.894294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05de43-64a2-4b9e-800b-d144e1937565 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.894498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05de43-64a2-4b9e-800b-d144e1937565 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.896118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 480/951] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:31.902142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747cea-a773-4631-9129-19922d1c649a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.902428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747cea-a773-4631-9129-19922d1c649a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.902709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747cea-a773-4631-9129-19922d1c649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.920997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d4747cea-a773-4631-9129-19922d1c649a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:31.922476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d4747cea-a773-4631-9129-19922d1c649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:31.937596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3a747-be11-4d37-85c5-2f942e71a2b3 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:31.971447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:31.972249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:31.972525 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:31.972793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:31.980860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:31.982324 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:31.997464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:31.998482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 11:32:31.999416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:31.999947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 481/952] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:32.000019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 472/953] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:32:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:32.005574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747cea-a773-4631-9129-19922d1c649a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.019394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.128446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747cea-a773-4631-9129-19922d1c649a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.157961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7bbb-2b56-449d-8674-ed3132da5b5b None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.165317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.166813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.167293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.167758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.168801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:32.169311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.170960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.197209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 482/954] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:32.197390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.198161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.198444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.198719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.199215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.199382 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.200736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:32.216213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:32.217271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:32.218161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:32.221771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 473/955] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:32.224603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.310122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8626f38-96f1-4f87-89a3-4178926276ac None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.339355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee21ab-7332-419c-a1a8-89b2861c7421 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.346046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96516c7a-4a76-421c-a322-835ebbe4259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.347090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96516c7a-4a76-421c-a322-835ebbe4259b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.347379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96516c7a-4a76-421c-a322-835ebbe4259b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.347654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96516c7a-4a76-421c-a322-835ebbe4259b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.372898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1234a-8439-4711-b01c-d45fcf274edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.373552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1234a-8439-4711-b01c-d45fcf274edc None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.373859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1234a-8439-4711-b01c-d45fcf274edc None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.374155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1234a-8439-4711-b01c-d45fcf274edc None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.374822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1234a-8439-4711-b01c-d45fcf274edc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:32.375119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1234a-8439-4711-b01c-d45fcf274edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.376462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1234a-8439-4711-b01c-d45fcf274edc None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.381288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 474/956] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:32.382347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf7e9-53ca-4409-8763-8ac12768480a None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.382626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf7e9-53ca-4409-8763-8ac12768480a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.382897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf7e9-53ca-4409-8763-8ac12768480a None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.384221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 475/957] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:32.388914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf7e9-53ca-4409-8763-8ac12768480a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.423021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96516c7a-4a76-421c-a322-835ebbe4259b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.424498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96516c7a-4a76-421c-a322-835ebbe4259b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.512872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf7e9-53ca-4409-8763-8ac12768480a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.527762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 483/958] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:32.529066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8892a6-fbc8-435f-883a-33197828bc77 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.529360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8892a6-fbc8-435f-883a-33197828bc77 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.529640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8892a6-fbc8-435f-883a-33197828bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.545473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-db8892a6-fbc8-435f-883a-33197828bc77 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:32.546689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-db8892a6-fbc8-435f-883a-33197828bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:32.555740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.556394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.556672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.557478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.558215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:32.558517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.559854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.564493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 476/959] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:32.565311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.650031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 484/960] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:32.672352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8892a6-fbc8-435f-883a-33197828bc77 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.688786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7c415-d7b5-4f77-a16c-fc60305055b8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.733105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.734563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.735455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.736059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.751950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.753977 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:32.773906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:32.774880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:32.776373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:32.776373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:32.776373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:32.776373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:32.778023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 477/961] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:32.783444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.801808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8892a6-fbc8-435f-883a-33197828bc77 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.840015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5824df-9714-47c0-b501-13e455e13d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.840815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5824df-9714-47c0-b501-13e455e13d02 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.841092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5824df-9714-47c0-b501-13e455e13d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.841364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5824df-9714-47c0-b501-13e455e13d02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.842040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5824df-9714-47c0-b501-13e455e13d02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.843397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5824df-9714-47c0-b501-13e455e13d02 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-1d5824df-9714-47c0-b501-13e455e13d02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:32.855050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:32.856067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:32.856925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 485/962] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:32.857781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991107a-68b7-40a3-961e-7729be770e9d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.858449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991107a-68b7-40a3-961e-7729be770e9d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.858449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991107a-68b7-40a3-961e-7729be770e9d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.861778 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 486/963] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:32.862949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991107a-68b7-40a3-961e-7729be770e9d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:32.896586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f0cd-85b5-40fe-903a-83e6edc744d1 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:32.931008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e934-5ee0-442f-baef-3b98c008fdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:32.931665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e934-5ee0-442f-baef-3b98c008fdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.931986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e934-5ee0-442f-baef-3b98c008fdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.932263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e934-5ee0-442f-baef-3b98c008fdb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.932978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e934-5ee0-442f-baef-3b98c008fdb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:32.933282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e934-5ee0-442f-baef-3b98c008fdb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:32.934649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e934-5ee0-442f-baef-3b98c008fdb6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:32.952186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 478/964] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:32.952186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea766f-8cd6-42b0-88d0-20e81411769c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:32.952186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea766f-8cd6-42b0-88d0-20e81411769c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:32.952186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea766f-8cd6-42b0-88d0-20e81411769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:32.968443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-a1ea766f-8cd6-42b0-88d0-20e81411769c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:32.969602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a1ea766f-8cd6-42b0-88d0-20e81411769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:32.970480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991107a-68b7-40a3-961e-7729be770e9d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.003877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.004813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.005097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.005375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.006129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:33.006439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.007810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.017392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 487/965] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:33.017392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.049723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 479/966] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:33.049723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea766f-8cd6-42b0-88d0-20e81411769c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.123058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432a5fc-185e-4fd9-bf90-596fcdc27723 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.144008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea766f-8cd6-42b0-88d0-20e81411769c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.156379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.157185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.157464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.157765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.164593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.166219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.177589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.178282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.178563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.178890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.179600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:33.179955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:33.180172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:33.181018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:33.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.188000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.188084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 488/967] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:33.188084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.192917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 480/968] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:33.198616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.279556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3b3a-5c5f-4c05-bafc-64656bccb60c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.301299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24aaf0-d6ab-445f-97d7-c101e3515c04 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.313112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.313793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.314072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.314343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.315037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.316462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.317827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING keystone.server.flask.common [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 11:32:33.335524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.sql.core [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 11:32:33.335524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 11:32:33.335524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [parameters: {'id': '6f240077b032425ebb4ffe009a400243', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 11:32:33.335524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80119) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 11:32:33.338551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.339212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.339494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.339767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.340551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:33.340860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.342350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6f240077b032425ebb4ffe009a400243.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6f240077b032425ebb4ffe009a400243. May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result = self._query(query) May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application conn.query(q) May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 11:32:33.343134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result.read() May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 11:32:33.343947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application next(self.gen) May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application yield resource May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application next(self.gen) May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.session.rollback() May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.force_reraise() May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise self.value May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application session.commit() May 12 11:32:33.350293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._prepare_impl() May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.session.flush() May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._flush(objects) May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application compat.raise_( May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application flush_context.execute() May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 11:32:33.351228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rec.execute(self) May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 11:32:33.352181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result = self._query(query) May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application conn.query(q) May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application result.read() May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 11:32:33.352974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [parameters: {'id': '6f240077b032425ebb4ffe009a400243', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:33.354513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:33.355293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6f240077b032425ebb4ffe009a400243. May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 489/969] 10.222.0.58 () {60 vars in 1140 bytes} [Thu May 12 11:32:33 2022] POST /identity/v3/projects => generated 262 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:33.356173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.366654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 481/970] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:33.367486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.461318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7e97-145a-4799-ad75-a81289c85d3c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.468987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18538833-8fc3-4460-b487-cc525cbcc9e5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.496549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.497201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.497484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.497775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.498511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.500081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.508043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.509051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.509362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.509957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.517931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.519481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.524701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 490/971] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:33.527323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:33.534674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:33.535671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:33.536691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:33.540953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 482/972] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:33.542862 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:33.659515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70b23-233d-474f-b27b-b0e8ac0ea7d7 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.680748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d335fa9-144e-49fe-963a-246368bfa8b7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:33.699984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443f6b6-b064-4f40-a300-bbc83dc789cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.701193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f6b6-b064-4f40-a300-bbc83dc789cc None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.701621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f6b6-b064-4f40-a300-bbc83dc789cc None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.702221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f6b6-b064-4f40-a300-bbc83dc789cc None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.703422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443f6b6-b064-4f40-a300-bbc83dc789cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:33.703877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443f6b6-b064-4f40-a300-bbc83dc789cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.705467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443f6b6-b064-4f40-a300-bbc83dc789cc None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.727277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 483/973] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:33.730586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d454640-96b1-4d2a-8dfb-29360fdd3b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:33.730586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d454640-96b1-4d2a-8dfb-29360fdd3b52 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:33.730925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d454640-96b1-4d2a-8dfb-29360fdd3b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:33.731111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d454640-96b1-4d2a-8dfb-29360fdd3b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:33.731977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d454640-96b1-4d2a-8dfb-29360fdd3b52 None admin] RBAC: Adding query filter params (role.id=f19dfea272f648fbb29eb721f2974dfa, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=7f0ef19cf7fb4fb2992d5b040fe80190) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:33.732292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d454640-96b1-4d2a-8dfb-29360fdd3b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:33.734525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d454640-96b1-4d2a-8dfb-29360fdd3b52 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:33.745765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 491/974] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:33 2022] GET /identity/v3/role_assignments?user.id=7f0ef19cf7fb4fb2992d5b040fe80190&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=f19dfea272f648fbb29eb721f2974dfa => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:34.839005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22bcf9-18f3-4322-b854-238a30627375 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:34.839505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22bcf9-18f3-4322-b854-238a30627375 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:34.839505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22bcf9-18f3-4322-b854-238a30627375 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:34.841068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 484/975] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:34.846500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4701eb-c24f-4aba-b690-83ef9bd536cb None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:34.846882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4701eb-c24f-4aba-b690-83ef9bd536cb None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:34.847060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4701eb-c24f-4aba-b690-83ef9bd536cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:34.863909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-9e4701eb-c24f-4aba-b690-83ef9bd536cb None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:34.865394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9e4701eb-c24f-4aba-b690-83ef9bd536cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:34.934245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 492/976] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:34.957263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22bcf9-18f3-4322-b854-238a30627375 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:35.057290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22bcf9-18f3-4322-b854-238a30627375 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:35.092242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57613d-1a9e-4506-9f49-529bfede1f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:35.092857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57613d-1a9e-4506-9f49-529bfede1f7d None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:35.093142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57613d-1a9e-4506-9f49-529bfede1f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:35.093414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57613d-1a9e-4506-9f49-529bfede1f7d None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:35.094171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57613d-1a9e-4506-9f49-529bfede1f7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:35.095530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57613d-1a9e-4506-9f49-529bfede1f7d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:35.112054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 485/977] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:34 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:35.862961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d21c5-902d-4517-8452-c7cef7e8ba17 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:35.864022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d21c5-902d-4517-8452-c7cef7e8ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:35.864520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d21c5-902d-4517-8452-c7cef7e8ba17 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:35.866671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 493/978] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:35.873176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b50deb-ae86-4df7-bf18-e69ba226b70c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:35.874215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b50deb-ae86-4df7-bf18-e69ba226b70c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:35.874732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b50deb-ae86-4df7-bf18-e69ba226b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:35.894100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-68b50deb-ae86-4df7-bf18-e69ba226b70c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:35.895782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-68b50deb-ae86-4df7-bf18-e69ba226b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:35.981803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 486/979] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:35.997564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d21c5-902d-4517-8452-c7cef7e8ba17 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.066825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d5704-10de-499e-b0aa-958571081654 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.067150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d5704-10de-499e-b0aa-958571081654 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.067384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d5704-10de-499e-b0aa-958571081654 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.069208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 487/980] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:36.075035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e73c7-4813-4067-8671-36b32d261f10 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.075035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e73c7-4813-4067-8671-36b32d261f10 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.075225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e73c7-4813-4067-8671-36b32d261f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.091456 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d53e73c7-4813-4067-8671-36b32d261f10 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:36.092770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d53e73c7-4813-4067-8671-36b32d261f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:36.101544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d21c5-902d-4517-8452-c7cef7e8ba17 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.139653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308a96e-9fda-43bc-9123-0b222a949dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.140369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a96e-9fda-43bc-9123-0b222a949dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.140802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a96e-9fda-43bc-9123-0b222a949dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.141079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a96e-9fda-43bc-9123-0b222a949dc0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.142038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308a96e-9fda-43bc-9123-0b222a949dc0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.143399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308a96e-9fda-43bc-9123-0b222a949dc0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.161873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 488/981] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-3308a96e-9fda-43bc-9123-0b222a949dc0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:36.162044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:36.163079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:36.163953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:36.164710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc44bf-2944-4178-a06c-97e6337ea2fc None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.164710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc44bf-2944-4178-a06c-97e6337ea2fc None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.164710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc44bf-2944-4178-a06c-97e6337ea2fc None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.164919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 494/982] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:36.165603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 489/983] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:36.169843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc44bf-2944-4178-a06c-97e6337ea2fc None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.169969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff430-3c5b-4042-815b-12ec21729d66 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.169969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff430-3c5b-4042-815b-12ec21729d66 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.169969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff430-3c5b-4042-815b-12ec21729d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.187516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c66ff430-3c5b-4042-815b-12ec21729d66 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:36.189213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c66ff430-3c5b-4042-815b-12ec21729d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:36.262249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 495/984] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:36.263852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff430-3c5b-4042-815b-12ec21729d66 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.275431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc44bf-2944-4178-a06c-97e6337ea2fc None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.310801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.311461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.311739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.312008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.312708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:36.313024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.314393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.319090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 490/985] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:36.320104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.376076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff430-3c5b-4042-815b-12ec21729d66 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.410238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.410950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.411234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.411512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] PATH_INFO: `/v3/services/image` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.412162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.413531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.422212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11105f-4731-42a7-a68d-462cf4865598 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:36.424816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:36.425877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:36.426847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 496/986] 10.222.0.58 () {56 vars in 1105 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:36.427879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.465047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.466289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.466289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.466289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.467407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.468850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.470184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING keystone.server.flask.common [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 11:32:36.482800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.sql.core [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 11:32:36.482800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 11:32:36.482800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [parameters: {'user_id': 'b90a48fbd99c41909f2f808b7876748a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 11:32:36.482800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80120) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application result = self._query(query) May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application conn.query(q) May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application result.read() May 12 11:32:36.499519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 11:32:36.500436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application next(self.gen) May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application yield resource May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application next(self.gen) May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self.session.rollback() May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self.force_reraise() May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise self.value May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application session.commit() May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 11:32:36.501388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._prepare_impl() May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self.session.flush() May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._flush(objects) May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application compat.raise_( May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application flush_context.execute() May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rec.execute(self) May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 11:32:36.502893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 11:32:36.503812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application result = self._query(query) May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application conn.query(q) May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application result.read() May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 11:32:36.504678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b90a48fbd99c41909f2f808b7876748a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:36.506617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 11:32:36.508739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 491/987] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 12 11:32:36 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:36.511935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.531148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7482777-a5d2-4633-a871-bdd354e8cc3a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.564169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.564828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.565111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.565416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.566127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:36.566443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.567863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.572978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 497/988] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:36.573557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.612602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217efc-ade1-4940-b1d6-b76cc1b6683b None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.646762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.647421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.647706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.647986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.648689 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:36.648995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.650624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.662771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 492/989] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:36.662771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.670540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1d193-c7ee-45b4-b617-8392e93da686 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.711349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.712143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.712425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.712709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.720697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.722175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:36.735912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:36.736863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 498/990] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:36.738435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.771339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98e4fe-44e3-4e51-a236-dac1a9e8b0d4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.805669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.806353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.806639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.806939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.808259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] RBAC: Adding query filter params (interface=admin, service_id=fb9562c910cf43c19bd727f0dee34563, region_id=RegionOne) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:36.808575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.809962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.819557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 493/991] 10.222.0.58 () {56 vars in 1249 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/endpoints?service_id=fb9562c910cf43c19bd727f0dee34563&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:36.819557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.843326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1541a-084e-43f4-b6d9-b5441530f6d0 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.877530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.878998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.879505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.879976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.880815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:36.881260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.882789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:36.888404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 499/992] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:36.889471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:36.924954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab2e6-d755-4ae6-98b0-6d62f123c10e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:36.967367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d54af-5e46-423d-8432-2444d43396cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:36.968231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d54af-5e46-423d-8432-2444d43396cc None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:36.968636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d54af-5e46-423d-8432-2444d43396cc None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:36.969014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d54af-5e46-423d-8432-2444d43396cc None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:36.970124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d54af-5e46-423d-8432-2444d43396cc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:36.970449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d54af-5e46-423d-8432-2444d43396cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:36.972018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d54af-5e46-423d-8432-2444d43396cc None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:37.003503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a986-9e15-4134-99e4-12499781aeb2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:37.015016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 494/993] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:37.044965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d362dc-2656-4bf8-b7fb-3b3c06ca8f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:37.045967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d362dc-2656-4bf8-b7fb-3b3c06ca8f9a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:37.046456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d362dc-2656-4bf8-b7fb-3b3c06ca8f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:37.046918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d362dc-2656-4bf8-b7fb-3b3c06ca8f9a None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:37.047835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d362dc-2656-4bf8-b7fb-3b3c06ca8f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:37.049433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d362dc-2656-4bf8-b7fb-3b3c06ca8f9a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:37.062183 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 500/994] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:36 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:32:37.419703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d078e-f887-4a27-81d6-5251569ed2e5 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:37.419987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d078e-f887-4a27-81d6-5251569ed2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:37.420266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d078e-f887-4a27-81d6-5251569ed2e5 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:37.421634 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 495/995] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:37.426790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448e2b6-edff-4ba3-943e-623a247ad7b1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:37.427081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448e2b6-edff-4ba3-943e-623a247ad7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:37.427363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448e2b6-edff-4ba3-943e-623a247ad7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:37.444525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6448e2b6-edff-4ba3-943e-623a247ad7b1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:37.445998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6448e2b6-edff-4ba3-943e-623a247ad7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:37.523115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 501/996] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:37.545102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d078e-f887-4a27-81d6-5251569ed2e5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:37.642153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d078e-f887-4a27-81d6-5251569ed2e5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:37.674759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:37.675464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:37.675741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:37.676011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:37.676657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:37.678025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:37.689983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:37.691018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:37.691863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:37.694033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 496/997] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:37.697327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448e2b6-edff-4ba3-943e-623a247ad7b1 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:37.794801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448e2b6-edff-4ba3-943e-623a247ad7b1 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:37.827665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:37.828322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:37.828597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:37.828864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:37.829562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:37.829893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:37.831249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:37.836048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 502/998] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:37.841521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:37.936228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10541e-d8e9-4acc-adf2-e00b8c918447 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:37.967103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:37.967752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:37.968029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:37.968300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:37.968996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:37.969298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:37.970676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:37.975405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 497/999] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:37.981501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:38.078628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9ff40-ef6c-4679-a61e-0b666b251c36 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:38.110537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165fd72-ed7e-4a31-b33a-e7b94fef65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:38.111181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165fd72-ed7e-4a31-b33a-e7b94fef65d8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:38.111459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165fd72-ed7e-4a31-b33a-e7b94fef65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:38.111727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165fd72-ed7e-4a31-b33a-e7b94fef65d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:38.112509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165fd72-ed7e-4a31-b33a-e7b94fef65d8 None admin] RBAC: Adding query filter params (interface=public, service_id=e92124d1fb464ae4b513285b8cfe09be, region_id=RegionOne) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:38.112892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165fd72-ed7e-4a31-b33a-e7b94fef65d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:38.114276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165fd72-ed7e-4a31-b33a-e7b94fef65d8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:38.121858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 503/1000] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:32:37 2022] GET /identity/v3/endpoints?service_id=e92124d1fb464ae4b513285b8cfe09be&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:38.125277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:38.223937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70468d1-a4b7-4fd2-88ed-4cc034fcb447 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:38.256139 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa0599-fd24-499a-8c6a-7d37da311d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:38.257091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa0599-fd24-499a-8c6a-7d37da311d87 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:38.257569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa0599-fd24-499a-8c6a-7d37da311d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:38.258082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa0599-fd24-499a-8c6a-7d37da311d87 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:38.259005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa0599-fd24-499a-8c6a-7d37da311d87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:38.261190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa0599-fd24-499a-8c6a-7d37da311d87 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:38.272936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 498/1001] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:38 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:32:39.158026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002977d-6dde-4b24-8d85-0b99b8e50692 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.158551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002977d-6dde-4b24-8d85-0b99b8e50692 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.158652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002977d-6dde-4b24-8d85-0b99b8e50692 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.159974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 504/1002] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:39.165110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b470-ac88-4c80-ae6a-9a7e99a83b6d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.165483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b470-ac88-4c80-ae6a-9a7e99a83b6d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.165675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b470-ac88-4c80-ae6a-9a7e99a83b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.183810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d268b470-ac88-4c80-ae6a-9a7e99a83b6d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:39.185304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d268b470-ac88-4c80-ae6a-9a7e99a83b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:39.248892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 499/1003] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:39.270895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002977d-6dde-4b24-8d85-0b99b8e50692 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:39.315006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603db5-5151-48f6-97f6-fbba14c89584 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.315334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603db5-5151-48f6-97f6-fbba14c89584 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.315564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603db5-5151-48f6-97f6-fbba14c89584 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.317055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 500/1004] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:39.322200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c2ffc-fb35-4fea-ae5e-d479d9f99b10 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.323222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c2ffc-fb35-4fea-ae5e-d479d9f99b10 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.323696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c2ffc-fb35-4fea-ae5e-d479d9f99b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.340670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-a74c2ffc-fb35-4fea-ae5e-d479d9f99b10 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:39.342079 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a74c2ffc-fb35-4fea-ae5e-d479d9f99b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:39.371280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002977d-6dde-4b24-8d85-0b99b8e50692 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:39.404868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:39.405942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.406308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.406676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.407573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:39.408993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:39.409835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 501/1005] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:39.424761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 505/1006] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:39 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:39.433273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c2ffc-fb35-4fea-ae5e-d479d9f99b10 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:39.542732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c2ffc-fb35-4fea-ae5e-d479d9f99b10 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:39.584234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:39.585038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.585315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.585579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.586258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:39.587610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:39.600031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:39.601114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:39.608147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 502/1007] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 12 11:32:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:39.610762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:39.711230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973874-744a-4c51-b613-9f0ee8448852 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:39.743551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:39.745061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.745565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.746090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.747144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:39.747665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:39.749264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:39.754766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 506/1008] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:39.760943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:39.861353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d88f2-2033-40fd-94e7-0aa101f90188 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:39.894002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35866e8-1db4-44bc-805a-d753de679ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:39.894666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35866e8-1db4-44bc-805a-d753de679ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:39.894947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35866e8-1db4-44bc-805a-d753de679ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:39.895221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35866e8-1db4-44bc-805a-d753de679ea4 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:39.895925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35866e8-1db4-44bc-805a-d753de679ea4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:39.896233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35866e8-1db4-44bc-805a-d753de679ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:39.897590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35866e8-1db4-44bc-805a-d753de679ea4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:39.902564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 503/1009] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 12 11:32:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:39.908740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:40.006212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3d8e7-61c3-4bd3-8ca6-4d0af2a33f8d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:40.039026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975050-1065-4265-95e8-7440dc014a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:40.039678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975050-1065-4265-95e8-7440dc014a3a None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:40.039961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975050-1065-4265-95e8-7440dc014a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:40.040235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975050-1065-4265-95e8-7440dc014a3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:40.040979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975050-1065-4265-95e8-7440dc014a3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:40.042404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975050-1065-4265-95e8-7440dc014a3a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:40.057525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 507/1010] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:40.527327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4196174-844e-4b79-8993-440cea5cb726 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:40.527815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4196174-844e-4b79-8993-440cea5cb726 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:40.527913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4196174-844e-4b79-8993-440cea5cb726 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:40.529388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 504/1011] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:40.534516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2a4f-c5ac-4f62-8ebe-53ebdc043554 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:40.534963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2a4f-c5ac-4f62-8ebe-53ebdc043554 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:40.535155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2a4f-c5ac-4f62-8ebe-53ebdc043554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:40.552094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-597a2a4f-c5ac-4f62-8ebe-53ebdc043554 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:40.553274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-597a2a4f-c5ac-4f62-8ebe-53ebdc043554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:40.625415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 508/1012] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:40 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:40.648184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4196174-844e-4b79-8993-440cea5cb726 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:40.746055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4196174-844e-4b79-8993-440cea5cb726 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:40.778714 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:40.779420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:40.779699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:40.779971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:40.780618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:40.781989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:40.793816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:40.794812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 11:32:40.795705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:40.798055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 505/1013] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:40.800932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a2a4f-c5ac-4f62-8ebe-53ebdc043554 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:40.896919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a2a4f-c5ac-4f62-8ebe-53ebdc043554 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:40.930682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:40.931345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:40.931629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:40.931930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:40.933163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:40.933469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:40.934865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:40.939672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 509/1014] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:40.945330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:41.040332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676250d8-4924-4004-a3fa-5c14f22a00a9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:41.073350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d2b7d-741d-4823-b200-41a5d97837c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:41.074034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d2b7d-741d-4823-b200-41a5d97837c5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:41.074315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d2b7d-741d-4823-b200-41a5d97837c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:41.074584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d2b7d-741d-4823-b200-41a5d97837c5 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:41.075284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d2b7d-741d-4823-b200-41a5d97837c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:41.075589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d2b7d-741d-4823-b200-41a5d97837c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:41.076940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d2b7d-741d-4823-b200-41a5d97837c5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:41.086381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 506/1015] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 12 11:32:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:41.087612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:41.184384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6cf32-cf75-4adf-b27f-9781d8111909 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:41.219345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133a9ae-536b-4b9f-9930-8eb3c39e8b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:41.220005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a9ae-536b-4b9f-9930-8eb3c39e8b9d None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:41.220291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a9ae-536b-4b9f-9930-8eb3c39e8b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:41.220567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a9ae-536b-4b9f-9930-8eb3c39e8b9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:41.221303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133a9ae-536b-4b9f-9930-8eb3c39e8b9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:41.222929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133a9ae-536b-4b9f-9930-8eb3c39e8b9d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:41.241923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 510/1016] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:41.680166 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107008c-eb62-4bba-ba44-f8dde2779cc5 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:41.680681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107008c-eb62-4bba-ba44-f8dde2779cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:41.680681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107008c-eb62-4bba-ba44-f8dde2779cc5 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:41.682802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 507/1017] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:41.687852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c922eb3-e6ca-40d7-abd5-fbb2b192d392 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:41.688240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c922eb3-e6ca-40d7-abd5-fbb2b192d392 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:41.688401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c922eb3-e6ca-40d7-abd5-fbb2b192d392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:41.705835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3c922eb3-e6ca-40d7-abd5-fbb2b192d392 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:41.706996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3c922eb3-e6ca-40d7-abd5-fbb2b192d392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:41.775989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 511/1018] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:41.798535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107008c-eb62-4bba-ba44-f8dde2779cc5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:41.897921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107008c-eb62-4bba-ba44-f8dde2779cc5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:41.930393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:41.931165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:41.931439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:41.931706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] PATH_INFO: `/v3/services/image` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:41.932919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:41.934293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:41.945726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:41.946727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:41.948082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:41.950058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 508/1019] 10.222.0.58 () {56 vars in 1105 bytes} [Thu May 12 11:32:41 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:41.953339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c922eb3-e6ca-40d7-abd5-fbb2b192d392 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:42.046322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c922eb3-e6ca-40d7-abd5-fbb2b192d392 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:42.079427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:42.080086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.080365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.080637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.081342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] RBAC: Adding query filter params (name=image) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:42.081718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:42.083030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:42.087952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 512/1020] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:42.093768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:42.193613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da42a1-ceb2-47f5-9d43-d831caf2330f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:42.225906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25a743-725b-4cf6-81b4-daa5178755c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:42.226564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a743-725b-4cf6-81b4-daa5178755c5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.226845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a743-725b-4cf6-81b4-daa5178755c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.227118 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a743-725b-4cf6-81b4-daa5178755c5 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.227815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25a743-725b-4cf6-81b4-daa5178755c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:42.228120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25a743-725b-4cf6-81b4-daa5178755c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:42.229488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25a743-725b-4cf6-81b4-daa5178755c5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:42.237785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 509/1021] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:42.240314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:42.301486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7825c7-a08a-46f2-89b0-2497d05c875b None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.301800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7825c7-a08a-46f2-89b0-2497d05c875b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.301991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7825c7-a08a-46f2-89b0-2497d05c875b None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.303471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 510/1022] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:42.308818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8782e29-7d99-48e4-b8c7-e84820fe9aef None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.309104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8782e29-7d99-48e4-b8c7-e84820fe9aef None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.309382 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8782e29-7d99-48e4-b8c7-e84820fe9aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.326244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c8782e29-7d99-48e4-b8c7-e84820fe9aef None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:42.327420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c8782e29-7d99-48e4-b8c7-e84820fe9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:42.335536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf54c88-aad0-4e51-9da3-c5f3cb92e081 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:42.370849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:42.371499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.371785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.372056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.372840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] RBAC: Adding query filter params (interface=public, service_id=26741f924bae45908551ded7d464f676, region_id=RegionOne) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:42.373149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:42.374695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:42.384111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 513/1023] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:32:42 2022] GET /identity/v3/endpoints?service_id=26741f924bae45908551ded7d464f676&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:42.385654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:42.393975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 511/1024] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:42.417410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8782e29-7d99-48e4-b8c7-e84820fe9aef None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:42.489832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2142f-a575-4477-9124-e950e0c3243b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:42.532990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8782e29-7d99-48e4-b8c7-e84820fe9aef None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:42.533184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:42.533817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.534101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.534374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.535047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:42.536418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:42.554039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 514/1025] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:32:42 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:32:42.568075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076238-1c89-41c7-935a-28ce9c464b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:42.568893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076238-1c89-41c7-935a-28ce9c464b33 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.569172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076238-1c89-41c7-935a-28ce9c464b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.569446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076238-1c89-41c7-935a-28ce9c464b33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.570993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28076238-1c89-41c7-935a-28ce9c464b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:42.572466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28076238-1c89-41c7-935a-28ce9c464b33 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:42.574748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 512/1026] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:42.580670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:42.685731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d87ceb-7aa6-4d75-9263-66846bf8e56b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:42.721544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2171505-c263-459a-bc19-a8e6e7eab6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:42.723028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2171505-c263-459a-bc19-a8e6e7eab6b8 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:42.723518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2171505-c263-459a-bc19-a8e6e7eab6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:42.724029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2171505-c263-459a-bc19-a8e6e7eab6b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:42.724748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2171505-c263-459a-bc19-a8e6e7eab6b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:42.726218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2171505-c263-459a-bc19-a8e6e7eab6b8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:42.753355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 515/1027] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:32:42 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:43.586097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4ac7-b055-4b6d-8f20-12221c84c5af None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:43.586603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4ac7-b055-4b6d-8f20-12221c84c5af None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:43.586708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4ac7-b055-4b6d-8f20-12221c84c5af None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:43.588007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 513/1028] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:43.593932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e78df-6e63-4d21-af02-9b732d629d43 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:43.594229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e78df-6e63-4d21-af02-9b732d629d43 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:43.594510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e78df-6e63-4d21-af02-9b732d629d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:43.611581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-901e78df-6e63-4d21-af02-9b732d629d43 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:43.612764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-901e78df-6e63-4d21-af02-9b732d629d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:43.679209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 516/1029] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:43.702194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4ac7-b055-4b6d-8f20-12221c84c5af None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:43.800260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4ac7-b055-4b6d-8f20-12221c84c5af None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:43.833383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:43.834230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:43.834511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:43.834784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:43.844470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:43.852411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:43.853326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:43.858881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 514/1030] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 12 11:32:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:43.862338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e78df-6e63-4d21-af02-9b732d629d43 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:43.961834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e78df-6e63-4d21-af02-9b732d629d43 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:43.995499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:43.996171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:43.996452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:43.996727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:43.997476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:43.997799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:43.999172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:44.011840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 517/1031] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 12 11:32:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:44.013010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:44.108422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66833b-f92b-49cf-a167-7a6a85e58f6f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:44.140470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:44.141257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:44.141537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:44.141838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:44.152489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:44.153953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:44.170681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:44.171600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:44.177639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:44.177639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:44.177639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:44.177639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:44.177639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 515/1032] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:44.177989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:44.274607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a71a4-339e-4bfd-a247-6cbab5c9dda6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:44.305993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:44.306654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:44.307469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:44.307747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:44.308465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:44.308770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:44.310152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:44.325743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 518/1033] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:44.328579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:44.425054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b700-cf32-472a-8427-17844be66141 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:44.461095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:44.461914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:44.462200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:44.462474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:44.470456 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:44.471881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:44.486444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:44.487513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:44.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:44.490922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 516/1034] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:32:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:44.493296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:44.594266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ee88c-cb1a-4288-9491-8815ba4e111e None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:44.629138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477bab4-d86e-43a7-bcd5-f37ae9adeea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:44.630235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477bab4-d86e-43a7-bcd5-f37ae9adeea6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:44.630704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477bab4-d86e-43a7-bcd5-f37ae9adeea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:44.631162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477bab4-d86e-43a7-bcd5-f37ae9adeea6 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:44.632182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477bab4-d86e-43a7-bcd5-f37ae9adeea6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:44.632700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477bab4-d86e-43a7-bcd5-f37ae9adeea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:44.634343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477bab4-d86e-43a7-bcd5-f37ae9adeea6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:44.652550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 519/1035] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:32:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:44.658528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:44.756520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb283-39e6-4438-86de-b47984f4de75 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:44.767498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2751f-bc80-407e-a965-1f7de17c9ef1 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:44.767789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2751f-bc80-407e-a965-1f7de17c9ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:44.768064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2751f-bc80-407e-a965-1f7de17c9ef1 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:44.769667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 520/1036] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:44.774431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67190931-a5bf-47c4-a75b-dab333739a87 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:44.774716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67190931-a5bf-47c4-a75b-dab333739a87 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:44.774992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67190931-a5bf-47c4-a75b-dab333739a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:44.794050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:44.794694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:44.794972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:44.795249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:44.800364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-67190931-a5bf-47c4-a75b-dab333739a87 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:44.801541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-67190931-a5bf-47c4-a75b-dab333739a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:44.864237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:44.866003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:44.872406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 521/1037] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:44.899858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67190931-a5bf-47c4-a75b-dab333739a87 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:44.974676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 517/1038] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:44.980648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:44.999723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67190931-a5bf-47c4-a75b-dab333739a87 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.033304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f3589-76a6-4b4c-aa63-519dffafcb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.034039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3589-76a6-4b4c-aa63-519dffafcb32 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.034323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3589-76a6-4b4c-aa63-519dffafcb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.034597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3589-76a6-4b4c-aa63-519dffafcb32 None admin] PATH_INFO: `/v3/services/image` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.035246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f3589-76a6-4b4c-aa63-519dffafcb32 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.036615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f3589-76a6-4b4c-aa63-519dffafcb32 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-774f3589-76a6-4b4c-aa63-519dffafcb32 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:45.048569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:45.049875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:45.050913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 522/1039] 10.222.0.58 () {56 vars in 1105 bytes} [Thu May 12 11:32:44 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:45.051893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c682-2770-4ec8-99f3-421f720728b4 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.051893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c682-2770-4ec8-99f3-421f720728b4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.051893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c682-2770-4ec8-99f3-421f720728b4 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.052712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 523/1040] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:45.055610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72c682-2770-4ec8-99f3-421f720728b4 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.085482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2758df9-34f1-4c0b-b34b-3c075db4a907 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.117833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f885b5-b8fc-476b-8e7f-609265154a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.118615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f885b5-b8fc-476b-8e7f-609265154a90 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.118898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f885b5-b8fc-476b-8e7f-609265154a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.119174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f885b5-b8fc-476b-8e7f-609265154a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.128844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f885b5-b8fc-476b-8e7f-609265154a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.130322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f885b5-b8fc-476b-8e7f-609265154a90 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-50f885b5-b8fc-476b-8e7f-609265154a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:45.147093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:45.148129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:45.149037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:45.149037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:45.149037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:45.149037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:45.149037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 518/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:45.149430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b190-b3c8-4988-b690-4e38a96378e0 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.149770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b190-b3c8-4988-b690-4e38a96378e0 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.149999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b190-b3c8-4988-b690-4e38a96378e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.157387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72c682-2770-4ec8-99f3-421f720728b4 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.167984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-97b3b190-b3c8-4988-b690-4e38a96378e0 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:45.170310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-97b3b190-b3c8-4988-b690-4e38a96378e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:45.197391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.198078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.198364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.198635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.199334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] RBAC: Adding query filter params (name=image) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:45.199637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.200999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.205639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 524/1042] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:45.206461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.237946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 519/1043] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:45.238784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b190-b3c8-4988-b690-4e38a96378e0 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.301061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e107df-a859-4c86-866f-2968be2fdf1b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.331479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b190-b3c8-4988-b690-4e38a96378e0 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.334273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.334919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.335201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.335472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.336185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:45.336485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.337865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.348709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 525/1044] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:45.349486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.364539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.365230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.365514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.365819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.366527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] RBAC: Adding query filter params (type=image) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:45.366836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.368187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.373427 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 520/1045] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:45.374220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.443217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348b432-08c9-411f-a9ac-ef3b52692ca7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.472694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfea3c-c192-496c-b87a-8519bc2c2dab None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.481015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.481840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.482125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.482398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.483588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.485560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.487218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 526/1046] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:45.487960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.516305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.517103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.517378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.517645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.528594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.530053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:45.548199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:45.549174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:45.550159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 521/1047] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:45.550708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.589233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26eb36-1263-483c-bf01-ab9cb53b5f18 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.620901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.621552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.621860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.622134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.622866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.624225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.642812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 527/1048] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:32:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:45.643511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.645968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360cfb-42dd-43b3-b7e6-c5000769c73d None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.690877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.691550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.691813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.692150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.692863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.694407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.718124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 522/1049] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:32:45 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:32:45.756829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6e0f-577c-4d2a-a374-284c4904daf9 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.795272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0bb2d-d2e7-4cee-93fb-83a65aae0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.795953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bb2d-d2e7-4cee-93fb-83a65aae0348 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.796233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bb2d-d2e7-4cee-93fb-83a65aae0348 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.796506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bb2d-d2e7-4cee-93fb-83a65aae0348 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.797353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0bb2d-d2e7-4cee-93fb-83a65aae0348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:45.797745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0bb2d-d2e7-4cee-93fb-83a65aae0348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.799172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0bb2d-d2e7-4cee-93fb-83a65aae0348 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.817746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 528/1050] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:45.820318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:45.932724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53ee8-0497-451c-9f8b-0dd64f35fb7e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:45.968600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38d7b-f35c-4095-a65b-c7b72c3a3fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:45.969252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38d7b-f35c-4095-a65b-c7b72c3a3fdd None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:45.969532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38d7b-f35c-4095-a65b-c7b72c3a3fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:45.969897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38d7b-f35c-4095-a65b-c7b72c3a3fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:45.970728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38d7b-f35c-4095-a65b-c7b72c3a3fdd None admin] RBAC: Adding query filter params (role.id=f19dfea272f648fbb29eb721f2974dfa, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=59372ef7ca2d439c8a2c12e29f8d97bf) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:45.971034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38d7b-f35c-4095-a65b-c7b72c3a3fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:45.972447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38d7b-f35c-4095-a65b-c7b72c3a3fdd None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:45.978930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 523/1051] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:45 2022] GET /identity/v3/role_assignments?user.id=59372ef7ca2d439c8a2c12e29f8d97bf&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=f19dfea272f648fbb29eb721f2974dfa => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:47.951023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9315-6e1c-4ab2-a2d8-bba4122a5a0f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:47.951514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9315-6e1c-4ab2-a2d8-bba4122a5a0f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:47.951514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9315-6e1c-4ab2-a2d8-bba4122a5a0f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:47.952876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 529/1052] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:47.958207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb1c16-f441-4fc7-b6de-5c76525d5d89 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:47.958661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb1c16-f441-4fc7-b6de-5c76525d5d89 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:47.958808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb1c16-f441-4fc7-b6de-5c76525d5d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:47.976991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0ecb1c16-f441-4fc7-b6de-5c76525d5d89 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:47.978256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0ecb1c16-f441-4fc7-b6de-5c76525d5d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:48.049743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 524/1053] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:48.068617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9315-6e1c-4ab2-a2d8-bba4122a5a0f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.081443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec31bd-06d0-406d-8286-b1a8d9a1385f None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.081735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec31bd-06d0-406d-8286-b1a8d9a1385f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.082013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec31bd-06d0-406d-8286-b1a8d9a1385f None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.083500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 525/1054] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:48.088833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb5a55-5f92-4b09-ab14-e7545aba3cb4 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.089115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb5a55-5f92-4b09-ab14-e7545aba3cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.089387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb5a55-5f92-4b09-ab14-e7545aba3cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.106767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-2acb5a55-5f92-4b09-ab14-e7545aba3cb4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:48.107940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2acb5a55-5f92-4b09-ab14-e7545aba3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:48.173627 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 526/1055] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:48.173868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9315-6e1c-4ab2-a2d8-bba4122a5a0f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.174959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2957ae-e11c-4763-bf80-f529de4c9385 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.175243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2957ae-e11c-4763-bf80-f529de4c9385 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.175554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2957ae-e11c-4763-bf80-f529de4c9385 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.176889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 527/1056] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:48.181867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871ae8e-ef94-4e3f-96fd-ff5a9ae62edd None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.182718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871ae8e-ef94-4e3f-96fd-ff5a9ae62edd None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.182990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871ae8e-ef94-4e3f-96fd-ff5a9ae62edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.199872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-1871ae8e-ef94-4e3f-96fd-ff5a9ae62edd None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:48.201101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1871ae8e-ef94-4e3f-96fd-ff5a9ae62edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:48.207927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.208571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.208845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.209112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.263234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 528/1057] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:48.264046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871ae8e-ef94-4e3f-96fd-ff5a9ae62edd None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.271634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:48.273075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:48.357263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871ae8e-ef94-4e3f-96fd-ff5a9ae62edd None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.367142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 530/1058] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:48.367961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.389406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.390208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.390487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.390756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.400189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:48.407693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:48.408753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 529/1059] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:48.409642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.463929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898341c3-f87e-49eb-b595-36fbf2279cf7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.496456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.497357 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.497536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.498102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.506077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ef92-812c-49e8-94ed-971fa674b7a0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.507418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:48.516049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:48.517108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 531/1060] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:48.518179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.541185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.541994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.542281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.542559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.552731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:48.554198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:48.570913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:48.571826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:48.573237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:48.573237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:48.573237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:48.573237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:48.573237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 530/1061] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:48.573534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.615901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5becf7-fd43-432f-9fc6-9b0aa5fa5120 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.647126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.647777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.648051 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.648320 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.649051 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:48.649354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:48.651361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:48.658984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 532/1062] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:48.659742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.670145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d45cf4-49fc-4d5b-87af-b2c108a9fffd None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.702284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.702935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.703218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.703492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.704227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:48.704536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:48.705908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:48.714135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 531/1063] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:48.714914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.753295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ad790-5d09-4748-9e0e-8b060ef61930 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.785480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.786162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.786447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.786726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.787439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:48.787749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:48.789119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:48.800871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 533/1064] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:48.801643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.812813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4d61-7454-49dc-afd0-92fd248ce9af None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.849819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.850720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.850984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.851255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] PATH_INFO: `/v3/users/34db12f1ed394646b4c2d7da20c56b6c` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.866418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] RBAC: Authorizing `identity:get_user(user_id=34db12f1ed394646b4c2d7da20c56b6c)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:48.868007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:48.874747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 532/1065] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/users/34db12f1ed394646b4c2d7da20c56b6c => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:48.875732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:48.911090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ec41-6c24-4279-9e90-fac5271efea1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.949374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:48.950199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:48.950487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:48.950766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:48.961353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:48.962858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:48.982215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:48.983333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:48.984449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:48.984449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:48.984449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:48.984449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:48.985159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 534/1066] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:48.987676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc449dd-2ffd-4622-b106-fcfada88b1cd None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:48.990820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.026834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.027486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.027772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.028073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.091485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cf39d-cbf9-43d6-a0e7-1c54176aee28 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.100664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.101419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.127098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.127759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.128043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.128314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.129034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:49.129338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.130815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.141574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 535/1067] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:49.147474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.196951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 533/1068] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:49.203996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.241719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0fa3-5e1f-4394-9e39-7ef53ad29029 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.273546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.274358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.274640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.274912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.282020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.283453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.295050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e02e0-9793-42ca-a73f-574c28fb4c6e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:49.297498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:49.298580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:49.299587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 536/1069] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:49.304264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.327922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.328770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.329052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.329323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.330532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] RBAC: Authorizing `identity:get_project(project_id=bec73ddd6ef74498a0ccc4da22029a47)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.331949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.333639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 534/1070] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:49.339818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.398667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d852-10b1-4c57-895f-0d2ec7d26cac None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.430578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.431239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.431525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.431805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.432313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a6e5-7ebe-4580-809a-d10033069161 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.432665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:49.432978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.434499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.452569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 537/1071] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:49.457734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.465740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.466395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.466673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.466946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.467774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=bec73ddd6ef74498a0ccc4da22029a47, user.id=34db12f1ed394646b4c2d7da20c56b6c) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:49.468083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.469503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.474828 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 535/1072] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/role_assignments?user.id=34db12f1ed394646b4c2d7da20c56b6c&scope.project.id=bec73ddd6ef74498a0ccc4da22029a47&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:49.561365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cda23-b02a-4434-b31c-348fee3df2f1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.596857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.597655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.597962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.598233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.609067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.610563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:49.628982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:49.630024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:49.630958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:49.630958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:49.630958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:49.630958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:49.630958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 538/1073] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:49.636853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.731277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7ce38-97bc-455d-b18a-32cef265591a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.765049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.765637 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.765947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.766223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.766945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:49.767255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.768611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.779476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 536/1074] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:49.785022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:49.879272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdf5f-8719-4799-85a0-66564fdf1b26 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:49.910451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:49.911231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:49.911515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:49.911790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:49.918715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:49.920153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:49.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:49.934949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:49.940623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 539/1075] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:32:49.941111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:50.033912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dceb24-decd-4847-86dd-d094a003fe14 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:50.065681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820892cc-bee4-41ac-afa4-c3c8a99baabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:50.066351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820892cc-bee4-41ac-afa4-c3c8a99baabf None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:50.066630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820892cc-bee4-41ac-afa4-c3c8a99baabf None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:50.066901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820892cc-bee4-41ac-afa4-c3c8a99baabf None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:50.067681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820892cc-bee4-41ac-afa4-c3c8a99baabf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:50.067986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820892cc-bee4-41ac-afa4-c3c8a99baabf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:50.069393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820892cc-bee4-41ac-afa4-c3c8a99baabf None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:50.081639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 537/1076] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:50.087457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:50.180750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828ea91-56b3-4ecb-a755-c6252a5746da None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:50.212718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19458c44-060c-443e-9dd9-7d90a6a678bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:50.214366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458c44-060c-443e-9dd9-7d90a6a678bf None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:50.214695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458c44-060c-443e-9dd9-7d90a6a678bf None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:50.214967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458c44-060c-443e-9dd9-7d90a6a678bf None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/59372ef7ca2d439c8a2c12e29f8d97bf/roles/f19dfea272f648fbb29eb721f2974dfa` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:50.217145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19458c44-060c-443e-9dd9-7d90a6a678bf None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=59372ef7ca2d439c8a2c12e29f8d97bf, role_id=f19dfea272f648fbb29eb721f2974dfa)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:50.218602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19458c44-060c-443e-9dd9-7d90a6a678bf None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:50.232393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 540/1077] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:32:50 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/59372ef7ca2d439c8a2c12e29f8d97bf/roles/f19dfea272f648fbb29eb721f2974dfa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:32:51.694879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf4c7-3686-4164-973a-59b508b6d0c3 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:51.695650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf4c7-3686-4164-973a-59b508b6d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:51.695740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf4c7-3686-4164-973a-59b508b6d0c3 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:51.697055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 538/1078] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:51.702718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fb7e-aaf5-4485-8831-035a6d1c6192 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:51.703164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fb7e-aaf5-4485-8831-035a6d1c6192 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:51.703261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fb7e-aaf5-4485-8831-035a6d1c6192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:51.720077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-9693fb7e-aaf5-4485-8831-035a6d1c6192 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:51.721314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9693fb7e-aaf5-4485-8831-035a6d1c6192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:51.784764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 541/1079] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:51.806504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf4c7-3686-4164-973a-59b508b6d0c3 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:51.908565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf4c7-3686-4164-973a-59b508b6d0c3 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:51.941174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:51.941996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:51.942279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:51.942549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:51.952600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:51.960304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:51.961422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:51.962805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 539/1080] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:51.968053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693fb7e-aaf5-4485-8831-035a6d1c6192 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:52.060870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693fb7e-aaf5-4485-8831-035a6d1c6192 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:52.093989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:52.094651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.094934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.095208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.095953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:52.096259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:52.097621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:52.105512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 542/1081] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:52.111362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:52.207997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e34d6-b0ba-4927-8710-e145c5cd913e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:52.240252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:52.241106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.241385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.241653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] PATH_INFO: `/v3/users/34db12f1ed394646b4c2d7da20c56b6c` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.242859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] RBAC: Authorizing `identity:get_user(user_id=34db12f1ed394646b4c2d7da20c56b6c)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:52.244291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:52.246563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 540/1082] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:32:52 2022] GET /identity/v3/users/34db12f1ed394646b4c2d7da20c56b6c => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:32:52.252286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:52.355873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033fc3e-055f-491b-bbf0-d0bb869a3c38 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:52.387812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59063cf8-c60d-4736-851d-21600bfa37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:52.388664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063cf8-c60d-4736-851d-21600bfa37be None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.388949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063cf8-c60d-4736-851d-21600bfa37be None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.389226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063cf8-c60d-4736-851d-21600bfa37be None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.390374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59063cf8-c60d-4736-851d-21600bfa37be None admin] RBAC: Authorizing `identity:get_project(project_id=bec73ddd6ef74498a0ccc4da22029a47)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:52.391814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59063cf8-c60d-4736-851d-21600bfa37be None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:52.393500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 543/1083] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:32:52 2022] GET /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:52.399424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:52.446639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f0636-7fac-4a33-876a-95f47edcdbce None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.446927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f0636-7fac-4a33-876a-95f47edcdbce None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.447206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f0636-7fac-4a33-876a-95f47edcdbce None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.449094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 544/1084] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:32:52.454049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128adf9-b9ff-4c67-8350-517ebe731fc1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.454337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128adf9-b9ff-4c67-8350-517ebe731fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.454612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128adf9-b9ff-4c67-8350-517ebe731fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.471906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8128adf9-b9ff-4c67-8350-517ebe731fc1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:52.473086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8128adf9-b9ff-4c67-8350-517ebe731fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:52.505167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0c10-8e93-4934-81df-b970c8e586c7 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:52.536922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:52.537828 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.538107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.538379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47/users/34db12f1ed394646b4c2d7da20c56b6c/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.540329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bec73ddd6ef74498a0ccc4da22029a47, user_id=34db12f1ed394646b4c2d7da20c56b6c, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:52.541794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:52.543171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 545/1085] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:52.555598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 541/1086] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:32:52 2022] PUT /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47/users/34db12f1ed394646b4c2d7da20c56b6c/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:32:52.568149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128adf9-b9ff-4c67-8350-517ebe731fc1 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:52.670827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128adf9-b9ff-4c67-8350-517ebe731fc1 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:52.706098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:52.706916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.707197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.707470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.718326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:52.726572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:52.727651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:52.728524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 546/1087] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 12 11:32:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:52.733903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:52.833880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6533b1d-684e-4209-9191-3b7778130aa5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:52.866871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:52.867518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:52.867799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:52.868076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:52.868843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:52.869151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:52.871091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:52.878781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 542/1088] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 12 11:32:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:52.884361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:52.980705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654963c9-438c-41f5-bfc1-2f2417232ef1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:53.012732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:53.013517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:53.013836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:53.014114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:53.024193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:53.025636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:53.042580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:53.043511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:53.044419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:53.044419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:53.044419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:53.044419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:53.044419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 547/1089] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:53.049415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:53.145106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a0891-0bf9-4925-9f8f-33c6b8ad0ca9 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:53.176491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:53.177146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:53.177428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:53.177715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:53.178440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:53.178747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:53.180099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:53.191737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 543/1090] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:53.197524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:53.291124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11663-0e1e-4445-baea-d447736dea2d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:53.324390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:53.325166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:53.325450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:53.325749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:53.332910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:53.334383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:32:53.348722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:53.349805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:53.350849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 548/1091] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 12 11:32:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:53.355695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:53.449822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69710653-47ca-414e-a170-7e20492f6113 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:53.481294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:53.481981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:53.482261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:53.482533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:53.483365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:53.483673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:53.485082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:53.502055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 544/1092] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 12 11:32:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:53.507475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:53.607769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c01e8e-b8ac-45ea-829d-cae088cf72d4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:53.639635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:53.640270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:53.640554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:53.640833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:53.707161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:53.708624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:53.802078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 549/1093] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:53.807844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:53.901792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465210-ea35-4af0-8e74-869e0d116746 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:53.932806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:53.933578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:53.933890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:53.934168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:53.943603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:53.945059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:32:53.962381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:53.963258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:53.964791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:32:53.964791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:32:53.964791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:32:53.964791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:53.964791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 545/1094] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:53.969745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:54.062874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5b441-55ce-4a17-b107-e25498187b75 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:54.095176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:54.095825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:54.096106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:54.096378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:54.097088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:54.097419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:54.098817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:54.109440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 550/1095] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:54.115053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:54.210470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8188-5e4e-4284-a3d1-d5d8747b0079 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:54.241970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:54.242751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:54.243033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:54.243307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:54.250309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:54.251729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:32:54.265942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:54.266932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:32:54.267856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 546/1096] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:32:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:54.272850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:54.369562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c283d-18e1-418c-ac35-9b3ab298d1e4 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:54.402633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc0e5c-51f7-4557-994b-bab8106b1f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:54.403455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0e5c-51f7-4557-994b-bab8106b1f08 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:54.403817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0e5c-51f7-4557-994b-bab8106b1f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:54.404123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0e5c-51f7-4557-994b-bab8106b1f08 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:54.404910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc0e5c-51f7-4557-994b-bab8106b1f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:54.405223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc0e5c-51f7-4557-994b-bab8106b1f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:54.406718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc0e5c-51f7-4557-994b-bab8106b1f08 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:54.419068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 551/1097] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:32:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:54.425148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:54.525941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9963cd-4b6b-49e6-bacb-2369ea08aa64 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:54.557875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4454d7c-6f6d-4442-b43b-249b1853835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:54.558519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454d7c-6f6d-4442-b43b-249b1853835c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:54.558800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454d7c-6f6d-4442-b43b-249b1853835c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:54.559076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454d7c-6f6d-4442-b43b-249b1853835c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:54.559894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4454d7c-6f6d-4442-b43b-249b1853835c None admin] RBAC: Adding query filter params (role.id=f19dfea272f648fbb29eb721f2974dfa, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=59372ef7ca2d439c8a2c12e29f8d97bf) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:54.560205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4454d7c-6f6d-4442-b43b-249b1853835c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:54.561622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4454d7c-6f6d-4442-b43b-249b1853835c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:54.567456 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 547/1098] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:54 2022] GET /identity/v3/role_assignments?user.id=59372ef7ca2d439c8a2c12e29f8d97bf&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=f19dfea272f648fbb29eb721f2974dfa => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:54.774490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c8fa-5353-40b8-8e03-f6d8001e8904 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:54.774997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c8fa-5353-40b8-8e03-f6d8001e8904 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:54.774997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c8fa-5353-40b8-8e03-f6d8001e8904 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:54.776341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 552/1099] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:54.781608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa2b98-4fdb-4252-b32c-e1eeb2832404 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:54.781926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa2b98-4fdb-4252-b32c-e1eeb2832404 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:54.782208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa2b98-4fdb-4252-b32c-e1eeb2832404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:54.798792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-40fa2b98-4fdb-4252-b32c-e1eeb2832404 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:54.799964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-40fa2b98-4fdb-4252-b32c-e1eeb2832404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:54.865069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 548/1100] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:32:54.891654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c8fa-5353-40b8-8e03-f6d8001e8904 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:54.990038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c8fa-5353-40b8-8e03-f6d8001e8904 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:55.022566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:55.023356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:55.023670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:55.023943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:55.034302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:32:55.042368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:32:55.043340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:32:55.044234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 553/1101] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:32:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:32:55.049602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa2b98-4fdb-4252-b32c-e1eeb2832404 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:55.151838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa2b98-4fdb-4252-b32c-e1eeb2832404 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:55.184417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:55.185113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:55.185393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:55.185664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:55.186443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:55.186744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:55.188124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:55.196341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 549/1102] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:55.202914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:55.303146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bec59-48d7-45eb-805c-504b05f16c5c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:55.336283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:55.337150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:55.337430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:55.337712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] PATH_INFO: `/v3/users/34db12f1ed394646b4c2d7da20c56b6c` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:55.338949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] RBAC: Authorizing `identity:get_user(user_id=34db12f1ed394646b4c2d7da20c56b6c)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:55.340376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:55.342058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 554/1103] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:32:55 2022] GET /identity/v3/users/34db12f1ed394646b4c2d7da20c56b6c => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:55.347809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:55.445018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46025593-a326-46a6-8315-d58e4b4284b2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:55.477827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:55.478463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:55.478744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:55.479045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:55.541884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:55.543311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:55.640112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 550/1104] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:32:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:32:55.646041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:55.741252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d175b-2f43-4d7d-8912-b01af7db60c0 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:55.773000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066242f-cd5e-483a-b962-60f9a772f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:55.773863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066242f-cd5e-483a-b962-60f9a772f792 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:55.774145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066242f-cd5e-483a-b962-60f9a772f792 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:55.774419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066242f-cd5e-483a-b962-60f9a772f792 None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:55.775575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066242f-cd5e-483a-b962-60f9a772f792 None admin] RBAC: Authorizing `identity:get_project(project_id=bec73ddd6ef74498a0ccc4da22029a47)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:55.777027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066242f-cd5e-483a-b962-60f9a772f792 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:55.778728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 555/1105] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:32:55 2022] GET /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:55.784710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:55.880731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082447a7-74f6-4e7c-98f1-6c85d279a77b None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:55.912303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afb06d-e632-4639-856a-610964fcb14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:55.912885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afb06d-e632-4639-856a-610964fcb14b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:55.913165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afb06d-e632-4639-856a-610964fcb14b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:55.913438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afb06d-e632-4639-856a-610964fcb14b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:55.914288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afb06d-e632-4639-856a-610964fcb14b None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=bec73ddd6ef74498a0ccc4da22029a47, user.id=34db12f1ed394646b4c2d7da20c56b6c) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:32:55.914601 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afb06d-e632-4639-856a-610964fcb14b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:55.916006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afb06d-e632-4639-856a-610964fcb14b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:55.922086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 551/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:32:55 2022] GET /identity/v3/role_assignments?user.id=34db12f1ed394646b4c2d7da20c56b6c&scope.project.id=bec73ddd6ef74498a0ccc4da22029a47&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:58.143144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d021f-c70d-4869-8ff3-a4d2394bb982 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:58.143702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d021f-c70d-4869-8ff3-a4d2394bb982 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:58.143702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d021f-c70d-4869-8ff3-a4d2394bb982 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:58.145029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 556/1107] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:32:58.150367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6c79-3eac-4562-9311-ec85361c959a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:58.150784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6c79-3eac-4562-9311-ec85361c959a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:58.150943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6c79-3eac-4562-9311-ec85361c959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:58.168223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e31d6c79-3eac-4562-9311-ec85361c959a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:32:58.169370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e31d6c79-3eac-4562-9311-ec85361c959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:32:58.230722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 552/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:32:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:32:58.254157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d021f-c70d-4869-8ff3-a4d2394bb982 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:58.349626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d021f-c70d-4869-8ff3-a4d2394bb982 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:58.382007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6aee1-845b-4075-886f-1c6303240cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:58.382799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6aee1-845b-4075-886f-1c6303240cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:58.383079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6aee1-845b-4075-886f-1c6303240cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:58.383351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6aee1-845b-4075-886f-1c6303240cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:58.384497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6aee1-845b-4075-886f-1c6303240cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:58.385984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6aee1-845b-4075-886f-1c6303240cc3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:58.387563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 557/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:32:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:32:58.393374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6c79-3eac-4562-9311-ec85361c959a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:32:58.487252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6c79-3eac-4562-9311-ec85361c959a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:32:58.518392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e4a2-6428-4ec7-912f-2382c581463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:32:58.519052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e4a2-6428-4ec7-912f-2382c581463d None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:32:58.519333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e4a2-6428-4ec7-912f-2382c581463d None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:32:58.519605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e4a2-6428-4ec7-912f-2382c581463d None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:32:58.520313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3e4a2-6428-4ec7-912f-2382c581463d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:32:58.521755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3e4a2-6428-4ec7-912f-2382c581463d None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:32:58.541253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 553/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:32:58 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:33:00.777132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54129c-9d45-41de-a1bb-17b2dee7b213 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:00.777631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54129c-9d45-41de-a1bb-17b2dee7b213 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:00.777631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54129c-9d45-41de-a1bb-17b2dee7b213 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:00.779013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 558/1111] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:00.784119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1398546-9ba0-4b70-8513-0b125e5e758f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:00.784509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1398546-9ba0-4b70-8513-0b125e5e758f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:00.784677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1398546-9ba0-4b70-8513-0b125e5e758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:00.801443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d1398546-9ba0-4b70-8513-0b125e5e758f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:00.802645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d1398546-9ba0-4b70-8513-0b125e5e758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:00.865069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 554/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:00.889246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54129c-9d45-41de-a1bb-17b2dee7b213 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:00.987941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54129c-9d45-41de-a1bb-17b2dee7b213 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:01.020281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:01.021117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:01.021401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:01.021679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] PATH_INFO: `/v3/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:01.023178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] RBAC: Authorizing `identity:get_role(role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:01.024535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:01.025926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 559/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:00 2022] GET /identity/v3/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:01.031789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1398546-9ba0-4b70-8513-0b125e5e758f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:01.124754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1398546-9ba0-4b70-8513-0b125e5e758f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:01.155537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:01.156375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:01.156651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:01.156917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] PATH_INFO: `/v3/users/7588493b37e74403be52dfef7423e829` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:01.169529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] RBAC: Authorizing `identity:get_user(user_id=7588493b37e74403be52dfef7423e829)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:01.170973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:01.172571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 555/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:01 2022] GET /identity/v3/users/7588493b37e74403be52dfef7423e829 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:01.178134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:01.271993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf14bb-de95-4315-b4ae-efa7320df1cf None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:01.304659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:01.305225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:01.305503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:01.305800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:01.367540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:01.368961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:01.459953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 560/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:33:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:33:01.466236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:01.559759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9252a-a545-4724-8f58-45fec9d09a11 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:01.591462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3a2d-a750-46bc-a118-131ce49cd3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:01.592294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3a2d-a750-46bc-a118-131ce49cd3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:01.592571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3a2d-a750-46bc-a118-131ce49cd3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:01.592840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3a2d-a750-46bc-a118-131ce49cd3b4 None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:01.594025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e3a2d-a750-46bc-a118-131ce49cd3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=bec73ddd6ef74498a0ccc4da22029a47)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:01.595446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e3a2d-a750-46bc-a118-131ce49cd3b4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:01.597110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 556/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:01 2022] GET /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:01.603265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:01.699846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd07e1-6026-434f-8999-d23ca43363ee None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:01.731648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6d3d7-0a15-4d2b-b5af-ca3112cad83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:01.732275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d3d7-0a15-4d2b-b5af-ca3112cad83f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:01.732550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d3d7-0a15-4d2b-b5af-ca3112cad83f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:01.732821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d3d7-0a15-4d2b-b5af-ca3112cad83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:01.733635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d3d7-0a15-4d2b-b5af-ca3112cad83f None admin] RBAC: Adding query filter params (role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=bec73ddd6ef74498a0ccc4da22029a47, user.id=7588493b37e74403be52dfef7423e829) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:01.733970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d3d7-0a15-4d2b-b5af-ca3112cad83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:01.735382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d3d7-0a15-4d2b-b5af-ca3112cad83f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:01.740485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 561/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:33:01 2022] GET /identity/v3/role_assignments?user.id=7588493b37e74403be52dfef7423e829&scope.project.id=bec73ddd6ef74498a0ccc4da22029a47&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:03.945027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f2529-6e61-4c8c-a8c7-48c35ace0c5d None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:03.945542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f2529-6e61-4c8c-a8c7-48c35ace0c5d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:03.945542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f2529-6e61-4c8c-a8c7-48c35ace0c5d None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:03.947172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 557/1118] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:03.953013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26006c07-63b3-4573-83aa-00672deb3e1c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:03.953439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26006c07-63b3-4573-83aa-00672deb3e1c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:03.953546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26006c07-63b3-4573-83aa-00672deb3e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:03.969856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-26006c07-63b3-4573-83aa-00672deb3e1c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:03.971030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-26006c07-63b3-4573-83aa-00672deb3e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:04.032789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 562/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:04.054763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f2529-6e61-4c8c-a8c7-48c35ace0c5d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:04.150573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f2529-6e61-4c8c-a8c7-48c35ace0c5d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:04.183460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:04.184289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:04.184564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:04.184835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] PATH_INFO: `/v3/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:04.186322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] RBAC: Authorizing `identity:get_role(role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:04.187685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:04.189051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 558/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:04 2022] GET /identity/v3/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:04.194611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26006c07-63b3-4573-83aa-00672deb3e1c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:04.286670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26006c07-63b3-4573-83aa-00672deb3e1c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:04.318931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:04.319783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:04.320066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:04.320341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] PATH_INFO: `/v3/users/7588493b37e74403be52dfef7423e829` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:04.321792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] RBAC: Authorizing `identity:get_user(user_id=7588493b37e74403be52dfef7423e829)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:04.323255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:04.324855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 563/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:04 2022] GET /identity/v3/users/7588493b37e74403be52dfef7423e829 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:04.330389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:04.422537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f448d-85e6-4a39-86bd-4d99c0735a5e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:04.454845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdbf1d-eccd-402f-a0eb-04561854037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:04.455682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdbf1d-eccd-402f-a0eb-04561854037a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:04.455959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdbf1d-eccd-402f-a0eb-04561854037a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:04.456228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdbf1d-eccd-402f-a0eb-04561854037a None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:04.457387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdbf1d-eccd-402f-a0eb-04561854037a None admin] RBAC: Authorizing `identity:get_project(project_id=bec73ddd6ef74498a0ccc4da22029a47)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:04.458843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdbf1d-eccd-402f-a0eb-04561854037a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:04.460499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 559/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:04 2022] GET /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:04.467016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:04.560870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45b934-e12d-40a4-8c7e-2c340fbcc355 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:04.593069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0007b1-db6a-49af-b3bd-1e3c5e5987ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:04.593959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0007b1-db6a-49af-b3bd-1e3c5e5987ae None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:04.594239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0007b1-db6a-49af-b3bd-1e3c5e5987ae None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:04.594509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0007b1-db6a-49af-b3bd-1e3c5e5987ae None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47/users/7588493b37e74403be52dfef7423e829/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:04.596647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0007b1-db6a-49af-b3bd-1e3c5e5987ae None admin] RBAC: Authorizing `identity:create_grant(project_id=bec73ddd6ef74498a0ccc4da22029a47, user_id=7588493b37e74403be52dfef7423e829, role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:04.598095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0007b1-db6a-49af-b3bd-1e3c5e5987ae None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:04.609971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 564/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:33:04 2022] PUT /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47/users/7588493b37e74403be52dfef7423e829/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:33:06.792833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2755b6a-9048-4bcb-93e4-9d7438416cf1 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:06.793351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2755b6a-9048-4bcb-93e4-9d7438416cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:06.793351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2755b6a-9048-4bcb-93e4-9d7438416cf1 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:06.794688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 560/1124] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:06.799943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda5d5-3182-4c9f-a24f-f6f73f36d5ee None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:06.800359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda5d5-3182-4c9f-a24f-f6f73f36d5ee None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:06.800497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda5d5-3182-4c9f-a24f-f6f73f36d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:06.816628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a5bda5d5-3182-4c9f-a24f-f6f73f36d5ee None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:06.817836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a5bda5d5-3182-4c9f-a24f-f6f73f36d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:06.881969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 565/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:06.906332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2755b6a-9048-4bcb-93e4-9d7438416cf1 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:07.001859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2755b6a-9048-4bcb-93e4-9d7438416cf1 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:07.035417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:07.036258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:07.036540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:07.036817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] PATH_INFO: `/v3/roles/feecf1b6b59742fb89de60e61e86f8d9` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:07.039798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] RBAC: Authorizing `identity:get_role(role_id=feecf1b6b59742fb89de60e61e86f8d9)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:07.042809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:07.044218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 561/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:06 2022] GET /identity/v3/roles/feecf1b6b59742fb89de60e61e86f8d9 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:33:07.050105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda5d5-3182-4c9f-a24f-f6f73f36d5ee None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:07.143667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda5d5-3182-4c9f-a24f-f6f73f36d5ee None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:07.175664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:07.176513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:07.176796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:07.177071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] PATH_INFO: `/v3/users/7588493b37e74403be52dfef7423e829` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:07.178270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] RBAC: Authorizing `identity:get_user(user_id=7588493b37e74403be52dfef7423e829)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:07.179695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:07.181287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 566/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:07 2022] GET /identity/v3/users/7588493b37e74403be52dfef7423e829 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:07.187321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:07.279568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5aa9-5d3f-41c8-bd2a-5757e008bad7 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:07.313765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:07.314345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:07.314626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:07.314902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:07.384877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:07.386391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:07.477625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 562/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:33:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:33:07.484112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:07.578626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260560e-981a-4229-9270-d6eaf2e33b1c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:07.610489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf7610-ec9d-4268-ac21-2de968d2b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:07.611330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7610-ec9d-4268-ac21-2de968d2b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:07.611615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7610-ec9d-4268-ac21-2de968d2b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:07.611890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7610-ec9d-4268-ac21-2de968d2b9a1 None admin] PATH_INFO: `/v3/projects/bec73ddd6ef74498a0ccc4da22029a47` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:07.613058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf7610-ec9d-4268-ac21-2de968d2b9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=bec73ddd6ef74498a0ccc4da22029a47)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:07.614620 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf7610-ec9d-4268-ac21-2de968d2b9a1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:07.616395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 567/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:07 2022] GET /identity/v3/projects/bec73ddd6ef74498a0ccc4da22029a47 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:07.623102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:07.720568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c965d-46e2-4898-b978-9396ef5a016c None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:07.752386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20133333-0f1a-4ea6-9e69-b4dfb2ea56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:07.753019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133333-0f1a-4ea6-9e69-b4dfb2ea56ad None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:07.753302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133333-0f1a-4ea6-9e69-b4dfb2ea56ad None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:07.753578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133333-0f1a-4ea6-9e69-b4dfb2ea56ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:07.754432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20133333-0f1a-4ea6-9e69-b4dfb2ea56ad None admin] RBAC: Adding query filter params (role.id=feecf1b6b59742fb89de60e61e86f8d9, scope.project.id=bec73ddd6ef74498a0ccc4da22029a47, user.id=7588493b37e74403be52dfef7423e829) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:07.754742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20133333-0f1a-4ea6-9e69-b4dfb2ea56ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:07.756164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20133333-0f1a-4ea6-9e69-b4dfb2ea56ad None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:07.761765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 563/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:33:07 2022] GET /identity/v3/role_assignments?user.id=7588493b37e74403be52dfef7423e829&scope.project.id=bec73ddd6ef74498a0ccc4da22029a47&role.id=feecf1b6b59742fb89de60e61e86f8d9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:09.970961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51b3e-078b-4325-8a40-12f11c46987b None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:09.971464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51b3e-078b-4325-8a40-12f11c46987b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:09.971464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51b3e-078b-4325-8a40-12f11c46987b None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:09.972781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 568/1131] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:09.978073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfdd58-c531-424d-b50e-7983d35cecda None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:09.978486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfdd58-c531-424d-b50e-7983d35cecda None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:09.978632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfdd58-c531-424d-b50e-7983d35cecda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:09.996476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-87bfdd58-c531-424d-b50e-7983d35cecda None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:09.997623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-87bfdd58-c531-424d-b50e-7983d35cecda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:10.059039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 564/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:10.082702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51b3e-078b-4325-8a40-12f11c46987b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:10.177297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51b3e-078b-4325-8a40-12f11c46987b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:10.208955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d33e3-0202-44b9-be08-ca81ef8be000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:10.209731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d33e3-0202-44b9-be08-ca81ef8be000 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:10.210016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d33e3-0202-44b9-be08-ca81ef8be000 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:10.210285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d33e3-0202-44b9-be08-ca81ef8be000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:10.211440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d33e3-0202-44b9-be08-ca81ef8be000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:10.212860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d33e3-0202-44b9-be08-ca81ef8be000 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:10.214483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 569/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:33:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:10.220010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfdd58-c531-424d-b50e-7983d35cecda None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:10.311767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfdd58-c531-424d-b50e-7983d35cecda None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:10.342710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06297-624a-4a56-9b1e-928b7ba5b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:10.343325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06297-624a-4a56-9b1e-928b7ba5b6f4 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:10.343600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06297-624a-4a56-9b1e-928b7ba5b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:10.343868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06297-624a-4a56-9b1e-928b7ba5b6f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:10.344568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee06297-624a-4a56-9b1e-928b7ba5b6f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:10.345986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee06297-624a-4a56-9b1e-928b7ba5b6f4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:10.370000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 565/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:33:10 2022] POST /identity/v3/projects => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:33:12.568653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfa378-5dbd-471b-98ed-723962b79365 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:12.569127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfa378-5dbd-471b-98ed-723962b79365 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:12.569235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfa378-5dbd-471b-98ed-723962b79365 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:12.570663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 570/1135] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:12.576536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710628de-33cd-4fcc-85e4-2e06c1d727ed None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:12.576904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710628de-33cd-4fcc-85e4-2e06c1d727ed None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:12.577093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710628de-33cd-4fcc-85e4-2e06c1d727ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:12.593733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-710628de-33cd-4fcc-85e4-2e06c1d727ed None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:12.594889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-710628de-33cd-4fcc-85e4-2e06c1d727ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:12.656607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 566/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:12.680450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfa378-5dbd-471b-98ed-723962b79365 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:12.776228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfa378-5dbd-471b-98ed-723962b79365 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:12.807463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ca8db-e202-4afe-b217-431fe0394768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:12.808721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca8db-e202-4afe-b217-431fe0394768 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:12.809001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca8db-e202-4afe-b217-431fe0394768 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:12.809274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca8db-e202-4afe-b217-431fe0394768 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:12.810450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ca8db-e202-4afe-b217-431fe0394768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:12.811872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ca8db-e202-4afe-b217-431fe0394768 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:12.813440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 571/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:33:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:12.819034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710628de-33cd-4fcc-85e4-2e06c1d727ed None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:12.912357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710628de-33cd-4fcc-85e4-2e06c1d727ed None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:12.944009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809641ac-d206-4c0c-8bef-79457abc9b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:12.944660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809641ac-d206-4c0c-8bef-79457abc9b29 None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:12.944944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809641ac-d206-4c0c-8bef-79457abc9b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:12.945222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809641ac-d206-4c0c-8bef-79457abc9b29 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:12.945961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809641ac-d206-4c0c-8bef-79457abc9b29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:12.947649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809641ac-d206-4c0c-8bef-79457abc9b29 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:12.966726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 567/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:33:12 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:33:15.186761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933c194-4a0b-4a41-a973-1a5ee392c338 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:15.187336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933c194-4a0b-4a41-a973-1a5ee392c338 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:15.187336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933c194-4a0b-4a41-a973-1a5ee392c338 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:15.188788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 572/1139] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:15.193926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc23c73-e853-4ea1-98bc-e837e6c951b3 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:15.194323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc23c73-e853-4ea1-98bc-e837e6c951b3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:15.194490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc23c73-e853-4ea1-98bc-e837e6c951b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:15.210933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-5bc23c73-e853-4ea1-98bc-e837e6c951b3 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:15.212106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5bc23c73-e853-4ea1-98bc-e837e6c951b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:15.282605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 568/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:15.306457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933c194-4a0b-4a41-a973-1a5ee392c338 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:15.401045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933c194-4a0b-4a41-a973-1a5ee392c338 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:15.432291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:15.433108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:15.433386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:15.433656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:15.443076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:33:15.451276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:33:15.452474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:33:15.453976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 573/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:33:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:33:15.458347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc23c73-e853-4ea1-98bc-e837e6c951b3 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:15.550508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc23c73-e853-4ea1-98bc-e837e6c951b3 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:15.582382 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:15.583026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:15.583306 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:15.583574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:15.584310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:15.584614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:15.585997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:15.594345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 569/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:33:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:33:15.599879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:15.695264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ff5d-6f91-46c6-9438-d4811cc754bd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:15.727542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:15.728383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:15.728656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:15.728922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] PATH_INFO: `/v3/users/7b64e122367c420a98c84a1450432910` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:15.741187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] RBAC: Authorizing `identity:get_user(user_id=7b64e122367c420a98c84a1450432910)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:15.742632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:15.744229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 574/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:15 2022] GET /identity/v3/users/7b64e122367c420a98c84a1450432910 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:15.754617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:15.854983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a488e-1e02-4bef-a9c7-430ca745a968 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:15.886803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:15.887431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:15.887713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:15.887989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:15.951418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:15.952797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:16.044635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 570/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:33:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:33:16.055045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:16.154673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de5a1-1944-4c02-892f-412bba2188f2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:16.186536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464808-8524-4b1d-8a19-e67d271d7f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:16.187431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464808-8524-4b1d-8a19-e67d271d7f81 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:16.187979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464808-8524-4b1d-8a19-e67d271d7f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:16.187979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464808-8524-4b1d-8a19-e67d271d7f81 None admin] PATH_INFO: `/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:16.189109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464808-8524-4b1d-8a19-e67d271d7f81 None admin] RBAC: Authorizing `identity:get_project(project_id=bf9251f7814844fd8a3aefafa6f38c0b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:16.190557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464808-8524-4b1d-8a19-e67d271d7f81 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:16.192201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 575/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:16 2022] GET /identity/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:33:16.199298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:16.295438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb040e-9c43-4352-acb8-d69469e39440 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:16.327552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af654759-9a9f-4d68-86f1-b863c91b743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:16.328192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af654759-9a9f-4d68-86f1-b863c91b743e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:16.328474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af654759-9a9f-4d68-86f1-b863c91b743e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:16.328747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af654759-9a9f-4d68-86f1-b863c91b743e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:16.329569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af654759-9a9f-4d68-86f1-b863c91b743e None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=bf9251f7814844fd8a3aefafa6f38c0b, user.id=7b64e122367c420a98c84a1450432910) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:16.329903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af654759-9a9f-4d68-86f1-b863c91b743e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:16.331313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af654759-9a9f-4d68-86f1-b863c91b743e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:16.336447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 571/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:33:16 2022] GET /identity/v3/role_assignments?user.id=7b64e122367c420a98c84a1450432910&scope.project.id=bf9251f7814844fd8a3aefafa6f38c0b&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:18.523235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcbaa2-75d9-4358-8d80-024709199035 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:18.523640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcbaa2-75d9-4358-8d80-024709199035 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:18.523780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcbaa2-75d9-4358-8d80-024709199035 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:18.525138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 576/1147] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:18.530365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a23e4-3ba4-4c3c-ac7e-bf207ae1ba32 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:18.530786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a23e4-3ba4-4c3c-ac7e-bf207ae1ba32 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:18.530929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a23e4-3ba4-4c3c-ac7e-bf207ae1ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:18.547530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-566a23e4-3ba4-4c3c-ac7e-bf207ae1ba32 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:18.548707 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-566a23e4-3ba4-4c3c-ac7e-bf207ae1ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:18.611279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 572/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:18.633720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcbaa2-75d9-4358-8d80-024709199035 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:18.727733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcbaa2-75d9-4358-8d80-024709199035 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:18.758743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:18.759445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:18.759721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:18.759993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:18.769870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:33:18.777843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:33:18.778804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:33:18.779718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 577/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:33:18.785044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a23e4-3ba4-4c3c-ac7e-bf207ae1ba32 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:18.882652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a23e4-3ba4-4c3c-ac7e-bf207ae1ba32 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:18.913968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:18.914616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:18.914896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:18.915168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:18.915899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:18.916201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:18.917603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:18.925185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 573/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:18.930992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:19.027130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145c62b-8564-42d5-8576-36167545ebfd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:19.057690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:19.059035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:19.059314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:19.059585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] PATH_INFO: `/v3/users/7b64e122367c420a98c84a1450432910` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:19.060762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] RBAC: Authorizing `identity:get_user(user_id=7b64e122367c420a98c84a1450432910)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:19.062228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:19.063809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 578/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:18 2022] GET /identity/v3/users/7b64e122367c420a98c84a1450432910 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:19.069178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:19.164436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e8a9a-e7bc-4dba-af7f-0428420ada7e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:19.196621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cdd92-ac9b-4f40-ba87-1ff6c511122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:19.197730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cdd92-ac9b-4f40-ba87-1ff6c511122f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:19.198011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cdd92-ac9b-4f40-ba87-1ff6c511122f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:19.198278 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cdd92-ac9b-4f40-ba87-1ff6c511122f None admin] PATH_INFO: `/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:19.199962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cdd92-ac9b-4f40-ba87-1ff6c511122f None admin] RBAC: Authorizing `identity:get_project(project_id=bf9251f7814844fd8a3aefafa6f38c0b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:19.201372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cdd92-ac9b-4f40-ba87-1ff6c511122f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:19.203068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 574/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:19 2022] GET /identity/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:19.208777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:19.303614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9458b-76ff-43d0-972b-a525af5c72c2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:19.335015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa8435-753e-4ad4-b18b-3bb28f37bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:19.335871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8435-753e-4ad4-b18b-3bb28f37bbd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:19.336156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8435-753e-4ad4-b18b-3bb28f37bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:19.336432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8435-753e-4ad4-b18b-3bb28f37bbd5 None admin] PATH_INFO: `/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b/users/7b64e122367c420a98c84a1450432910/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:19.338391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa8435-753e-4ad4-b18b-3bb28f37bbd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf9251f7814844fd8a3aefafa6f38c0b, user_id=7b64e122367c420a98c84a1450432910, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:19.340396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa8435-753e-4ad4-b18b-3bb28f37bbd5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:19.352880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 579/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:33:19 2022] PUT /identity/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b/users/7b64e122367c420a98c84a1450432910/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:33:21.542711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e2ba5-1cf6-4bd8-aa2d-0661157fdf96 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:21.543139 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e2ba5-1cf6-4bd8-aa2d-0661157fdf96 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:21.543254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e2ba5-1cf6-4bd8-aa2d-0661157fdf96 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:21.544629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 575/1154] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:21.549767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f78f05-28a4-469e-a4fc-a5b2678bf9d4 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:21.550190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f78f05-28a4-469e-a4fc-a5b2678bf9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:21.550327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f78f05-28a4-469e-a4fc-a5b2678bf9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:21.566338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-28f78f05-28a4-469e-a4fc-a5b2678bf9d4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:21.567489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-28f78f05-28a4-469e-a4fc-a5b2678bf9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:21.629512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 580/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:21.653645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e2ba5-1cf6-4bd8-aa2d-0661157fdf96 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:21.751705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e2ba5-1cf6-4bd8-aa2d-0661157fdf96 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:21.782664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:21.783433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:21.783713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:21.783987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:21.794571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:33:21.802082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:33:21.803149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:33:21.804391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 576/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:33:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:33:21.809194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f78f05-28a4-469e-a4fc-a5b2678bf9d4 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:21.900732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f78f05-28a4-469e-a4fc-a5b2678bf9d4 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:21.931558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:21.932197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:21.932473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:21.932741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:21.934015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:21.934318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:21.935665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:21.943149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 581/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:33:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:21.949578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:22.040972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843647a-fb2d-44b4-83ac-da736a75ce25 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:22.072541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:22.073379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:22.074227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:22.074502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] PATH_INFO: `/v3/users/7b64e122367c420a98c84a1450432910` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:22.075676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] RBAC: Authorizing `identity:get_user(user_id=7b64e122367c420a98c84a1450432910)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:22.077087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:22.078690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 577/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:21 2022] GET /identity/v3/users/7b64e122367c420a98c84a1450432910 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:22.084289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:22.176652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad432b4-9f16-46cb-9911-d348b74a2204 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:22.216212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:22.216839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:22.217118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:22.217387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:22.279435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:22.280869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:22.370303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 582/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:33:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:33:22.376213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:22.469364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34f7fb-c353-4ed4-831a-17651e1508d8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:22.507245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395cde9-95e3-4c9a-836c-f082167d0eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:22.508101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395cde9-95e3-4c9a-836c-f082167d0eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:22.508384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395cde9-95e3-4c9a-836c-f082167d0eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:22.508660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395cde9-95e3-4c9a-836c-f082167d0eb2 None admin] PATH_INFO: `/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:22.509862 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395cde9-95e3-4c9a-836c-f082167d0eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=bf9251f7814844fd8a3aefafa6f38c0b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:22.511966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395cde9-95e3-4c9a-836c-f082167d0eb2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:22.513660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 578/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:22 2022] GET /identity/v3/projects/bf9251f7814844fd8a3aefafa6f38c0b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:22.519658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:22.614098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813175c0-8cd9-42f9-bb3b-e944dce86e07 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:22.646512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7fe2-954d-4c89-b633-d0cfcbcc37e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:22.647085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7fe2-954d-4c89-b633-d0cfcbcc37e4 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:22.647369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7fe2-954d-4c89-b633-d0cfcbcc37e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:22.647645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7fe2-954d-4c89-b633-d0cfcbcc37e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:22.648467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7fe2-954d-4c89-b633-d0cfcbcc37e4 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=bf9251f7814844fd8a3aefafa6f38c0b, user.id=7b64e122367c420a98c84a1450432910) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:22.648776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7fe2-954d-4c89-b633-d0cfcbcc37e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:22.650230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7fe2-954d-4c89-b633-d0cfcbcc37e4 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:22.656317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 583/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:33:22 2022] GET /identity/v3/role_assignments?user.id=7b64e122367c420a98c84a1450432910&scope.project.id=bf9251f7814844fd8a3aefafa6f38c0b&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:24.908607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144a87-9edf-480c-810a-62ef5b7c2c65 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:24.909104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144a87-9edf-480c-810a-62ef5b7c2c65 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:24.909104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144a87-9edf-480c-810a-62ef5b7c2c65 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:24.910458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 579/1162] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:24.915629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3955ae-220f-443c-9560-c8dfb2b07c85 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:24.915994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3955ae-220f-443c-9560-c8dfb2b07c85 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:24.916209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3955ae-220f-443c-9560-c8dfb2b07c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:24.936208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7b3955ae-220f-443c-9560-c8dfb2b07c85 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:24.937384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7b3955ae-220f-443c-9560-c8dfb2b07c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:25.005693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 584/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:25.030993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85144a87-9edf-480c-810a-62ef5b7c2c65 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:25.140245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85144a87-9edf-480c-810a-62ef5b7c2c65 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:25.176703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:25.177274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:25.177552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:25.177857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:25.248018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:25.249441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:25.340835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 580/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:33:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:33:25.346814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3955ae-220f-443c-9560-c8dfb2b07c85 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:25.440319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3955ae-220f-443c-9560-c8dfb2b07c85 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:25.472612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f053a-08dd-4262-9f4e-45fe9074182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:25.473433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f053a-08dd-4262-9f4e-45fe9074182c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:25.473744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f053a-08dd-4262-9f4e-45fe9074182c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:25.474026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f053a-08dd-4262-9f4e-45fe9074182c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:25.480912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f053a-08dd-4262-9f4e-45fe9074182c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:25.482385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f053a-08dd-4262-9f4e-45fe9074182c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-999f053a-08dd-4262-9f4e-45fe9074182c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:33:25.496196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:33:25.502021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:33:25.503684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 585/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:33:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:33:25.504709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:25.595121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14838f8-fd43-44b4-aa31-eccb94bc9019 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:25.626263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9e0b4-7711-45bc-b9ec-01b8bb72030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:25.626899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e0b4-7711-45bc-b9ec-01b8bb72030b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:25.627174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e0b4-7711-45bc-b9ec-01b8bb72030b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:25.627443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e0b4-7711-45bc-b9ec-01b8bb72030b None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:25.628145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9e0b4-7711-45bc-b9ec-01b8bb72030b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:25.628444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9e0b4-7711-45bc-b9ec-01b8bb72030b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:25.629805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9e0b4-7711-45bc-b9ec-01b8bb72030b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:25.636609 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 581/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 12 11:33:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:27.802468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4c43-9ec8-4476-8222-373f0f19d6ac None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:27.803010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4c43-9ec8-4476-8222-373f0f19d6ac None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:27.803010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4c43-9ec8-4476-8222-373f0f19d6ac None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:27.804294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 586/1167] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:27.809614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d6300-bae3-4afb-a194-2f0ee00b6928 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:27.810057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d6300-bae3-4afb-a194-2f0ee00b6928 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:27.810190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d6300-bae3-4afb-a194-2f0ee00b6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:27.826366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e49d6300-bae3-4afb-a194-2f0ee00b6928 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:27.827529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e49d6300-bae3-4afb-a194-2f0ee00b6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:27.889377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 582/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:33:27.912120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab4c43-9ec8-4476-8222-373f0f19d6ac None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:28.007902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab4c43-9ec8-4476-8222-373f0f19d6ac None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:28.039035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3f01-ab01-434b-8bed-87e14a9f3b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:28.039662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3f01-ab01-434b-8bed-87e14a9f3b69 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:28.039937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3f01-ab01-434b-8bed-87e14a9f3b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:28.040205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3f01-ab01-434b-8bed-87e14a9f3b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:28.040920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3f01-ab01-434b-8bed-87e14a9f3b69 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:28.042297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3f01-ab01-434b-8bed-87e14a9f3b69 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:28.055918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 587/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Thu May 12 11:33:27 2022] POST /identity/v3/domains => generated 267 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:33:30.279961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddcd10-cf6d-43f0-b166-0d0df4775bc5 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:30.280516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddcd10-cf6d-43f0-b166-0d0df4775bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:30.280516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddcd10-cf6d-43f0-b166-0d0df4775bc5 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:30.282018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 583/1170] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:30.287271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86748a5-614f-4915-8926-ab9ee0c37ac5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:30.287685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86748a5-614f-4915-8926-ab9ee0c37ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:30.287830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86748a5-614f-4915-8926-ab9ee0c37ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:30.304742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b86748a5-614f-4915-8926-ab9ee0c37ac5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:30.305942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b86748a5-614f-4915-8926-ab9ee0c37ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:30.368939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 588/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:30.392186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddcd10-cf6d-43f0-b166-0d0df4775bc5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:30.487564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddcd10-cf6d-43f0-b166-0d0df4775bc5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:30.519463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a138-1450-4b24-8470-7586523695b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:30.520302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a138-1450-4b24-8470-7586523695b8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:30.520583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a138-1450-4b24-8470-7586523695b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:30.520857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a138-1450-4b24-8470-7586523695b8 None admin] PATH_INFO: `/v3/domains/315aa3bea3fe4eebb06e644c30b91151` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:30.531415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727a138-1450-4b24-8470-7586523695b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=315aa3bea3fe4eebb06e644c30b91151)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:30.532798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727a138-1450-4b24-8470-7586523695b8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:30.534445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 584/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Thu May 12 11:33:30 2022] GET /identity/v3/domains/315aa3bea3fe4eebb06e644c30b91151 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:30.540221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86748a5-614f-4915-8926-ab9ee0c37ac5 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:30.631664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86748a5-614f-4915-8926-ab9ee0c37ac5 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:30.663812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e837db9-c46c-4ec9-afaf-3a061bbfba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:30.664444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e837db9-c46c-4ec9-afaf-3a061bbfba86 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:30.664724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e837db9-c46c-4ec9-afaf-3a061bbfba86 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:30.664998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e837db9-c46c-4ec9-afaf-3a061bbfba86 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:30.665723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e837db9-c46c-4ec9-afaf-3a061bbfba86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:30.667146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e837db9-c46c-4ec9-afaf-3a061bbfba86 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:30.691441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 589/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:33:30 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:33:32.938761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cb9ac-e07c-4fd4-843d-25b6af284590 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:32.939285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cb9ac-e07c-4fd4-843d-25b6af284590 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:32.939285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cb9ac-e07c-4fd4-843d-25b6af284590 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:32.940577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 585/1174] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:32.945757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bc01f-ca04-4108-ad9d-60f542e3f749 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:32.946172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bc01f-ca04-4108-ad9d-60f542e3f749 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:32.946327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bc01f-ca04-4108-ad9d-60f542e3f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:32.966960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-072bc01f-ca04-4108-ad9d-60f542e3f749 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:32.968143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-072bc01f-ca04-4108-ad9d-60f542e3f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:33.030759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 590/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:33.055335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cb9ac-e07c-4fd4-843d-25b6af284590 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:33.148518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cb9ac-e07c-4fd4-843d-25b6af284590 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:33.179782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af054d6-d43f-4891-9c60-95bbddc463b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:33.180610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af054d6-d43f-4891-9c60-95bbddc463b5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:33.180888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af054d6-d43f-4891-9c60-95bbddc463b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:33.181158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af054d6-d43f-4891-9c60-95bbddc463b5 None admin] PATH_INFO: `/v3/domains/315aa3bea3fe4eebb06e644c30b91151` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:33.182319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af054d6-d43f-4891-9c60-95bbddc463b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=315aa3bea3fe4eebb06e644c30b91151)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:33.183751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af054d6-d43f-4891-9c60-95bbddc463b5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:33.185311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 586/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Thu May 12 11:33:33 2022] GET /identity/v3/domains/315aa3bea3fe4eebb06e644c30b91151 => generated 267 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:33.190864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bc01f-ca04-4108-ad9d-60f542e3f749 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:33.287708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bc01f-ca04-4108-ad9d-60f542e3f749 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:33.319371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45fba4-98b9-43cf-b2fe-b26ed969fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:33.320028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45fba4-98b9-43cf-b2fe-b26ed969fc6c None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:33.320313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45fba4-98b9-43cf-b2fe-b26ed969fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:33.320590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45fba4-98b9-43cf-b2fe-b26ed969fc6c None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:33.321302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45fba4-98b9-43cf-b2fe-b26ed969fc6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:33.322767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45fba4-98b9-43cf-b2fe-b26ed969fc6c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:33.342607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 591/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:33:33 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:33:35.598368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ba65-c821-4d6c-a8d5-49c0d9b1eadf None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:35.598898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ba65-c821-4d6c-a8d5-49c0d9b1eadf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:35.598898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ba65-c821-4d6c-a8d5-49c0d9b1eadf None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:35.600281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 587/1178] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:35.606097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672ea3-6c2e-4c23-b664-77d72c010309 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:35.606540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672ea3-6c2e-4c23-b664-77d72c010309 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:35.606682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672ea3-6c2e-4c23-b664-77d72c010309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:35.623313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-db672ea3-6c2e-4c23-b664-77d72c010309 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:35.624488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-db672ea3-6c2e-4c23-b664-77d72c010309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:35.686836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 592/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:35.709675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ba65-c821-4d6c-a8d5-49c0d9b1eadf None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:35.807273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ba65-c821-4d6c-a8d5-49c0d9b1eadf None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:35.838314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:35.839089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:35.839367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:35.839639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:35.850156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:33:35.857653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:33:35.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:33:35.859730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 588/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:33:35.864915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db672ea3-6c2e-4c23-b664-77d72c010309 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:35.956916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db672ea3-6c2e-4c23-b664-77d72c010309 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:35.988249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:35.988882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:35.989160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:35.989430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:35.990191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:35.990494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:35.991843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:36.000299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 593/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:36.005876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:36.108751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8beceaf-66bd-4cc7-9f04-6de171a9aec8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:36.139967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:36.140815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:36.141091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:36.141360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] PATH_INFO: `/v3/users/1b29f6e0fd95426694eb8175f63c9254` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:36.153933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] RBAC: Authorizing `identity:get_user(user_id=1b29f6e0fd95426694eb8175f63c9254)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:36.155352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:36.156941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 589/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:36 2022] GET /identity/v3/users/1b29f6e0fd95426694eb8175f63c9254 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:36.162679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:36.257041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1976-423e-42af-9d8d-f8d3297973af None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:36.288587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:36.289213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:36.289498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:36.289798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:36.353274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:36.354736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:36.445722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 594/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:33:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:33:36.452360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:36.545855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75081f12-bae2-401d-8790-8e2652664f34 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:36.577705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7f2cb-720a-4278-ba0a-eea61dfddcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:36.578558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f2cb-720a-4278-ba0a-eea61dfddcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:36.578840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f2cb-720a-4278-ba0a-eea61dfddcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:36.579112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f2cb-720a-4278-ba0a-eea61dfddcf6 None admin] PATH_INFO: `/v3/projects/e51576e6ceba4091baf7693540cbdf39` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:36.580281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7f2cb-720a-4278-ba0a-eea61dfddcf6 None admin] RBAC: Authorizing `identity:get_project(project_id=e51576e6ceba4091baf7693540cbdf39)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:36.581695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7f2cb-720a-4278-ba0a-eea61dfddcf6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:36.583395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 590/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:36 2022] GET /identity/v3/projects/e51576e6ceba4091baf7693540cbdf39 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:36.589496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:36.681074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfe4f-a7c0-49c6-90ae-239224433da6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:36.713204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb0ce-599d-44bb-84e5-637580808bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:36.713804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb0ce-599d-44bb-84e5-637580808bad None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:36.714088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb0ce-599d-44bb-84e5-637580808bad None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:36.714361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb0ce-599d-44bb-84e5-637580808bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:36.715782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb0ce-599d-44bb-84e5-637580808bad None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=e51576e6ceba4091baf7693540cbdf39, user.id=1b29f6e0fd95426694eb8175f63c9254) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:36.716094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb0ce-599d-44bb-84e5-637580808bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:36.717515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb0ce-599d-44bb-84e5-637580808bad None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:36.722698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 595/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:33:36 2022] GET /identity/v3/role_assignments?user.id=1b29f6e0fd95426694eb8175f63c9254&scope.project.id=e51576e6ceba4091baf7693540cbdf39&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:38.899448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71cb2b-93ee-4ec6-b891-de3860402d99 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:38.900054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71cb2b-93ee-4ec6-b891-de3860402d99 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:38.900054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71cb2b-93ee-4ec6-b891-de3860402d99 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:38.901288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 591/1186] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:33:38.907187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702bd9-38df-4acd-9fed-ff7006d8c381 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:38.907649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702bd9-38df-4acd-9fed-ff7006d8c381 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:38.907796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702bd9-38df-4acd-9fed-ff7006d8c381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:38.924460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ee702bd9-38df-4acd-9fed-ff7006d8c381 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:38.925628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ee702bd9-38df-4acd-9fed-ff7006d8c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:38.989038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 596/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:33:39.012639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71cb2b-93ee-4ec6-b891-de3860402d99 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:39.108061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71cb2b-93ee-4ec6-b891-de3860402d99 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:39.140738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:39.141505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:39.141813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:39.142090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:39.151744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:33:39.159328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:33:39.160419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:33:39.161463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 592/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:33:39.166244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702bd9-38df-4acd-9fed-ff7006d8c381 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:39.265598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702bd9-38df-4acd-9fed-ff7006d8c381 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:39.297321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:39.297997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:39.298280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:39.298553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:39.299286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:39.299588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:39.300941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:39.308486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 597/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:39.314824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:39.408802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6125692-2bc1-41d2-a169-20915e907c90 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:39.440210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:39.441045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:39.441320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:39.441585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] PATH_INFO: `/v3/users/1b29f6e0fd95426694eb8175f63c9254` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:39.442766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] RBAC: Authorizing `identity:get_user(user_id=1b29f6e0fd95426694eb8175f63c9254)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:39.444173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:39.445787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 593/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:39 2022] GET /identity/v3/users/1b29f6e0fd95426694eb8175f63c9254 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:39.451728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:39.546209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5a920-aa80-4e83-a456-5705d29e3be6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:39.577632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f12dc-871a-4550-aac8-1ec49e9f7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:39.578495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f12dc-871a-4550-aac8-1ec49e9f7095 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:39.578770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f12dc-871a-4550-aac8-1ec49e9f7095 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:39.579039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f12dc-871a-4550-aac8-1ec49e9f7095 None admin] PATH_INFO: `/v3/projects/e51576e6ceba4091baf7693540cbdf39` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:39.580199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f12dc-871a-4550-aac8-1ec49e9f7095 None admin] RBAC: Authorizing `identity:get_project(project_id=e51576e6ceba4091baf7693540cbdf39)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:39.581621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f12dc-871a-4550-aac8-1ec49e9f7095 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:39.583325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 598/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:39 2022] GET /identity/v3/projects/e51576e6ceba4091baf7693540cbdf39 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:39.589091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:39.682417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69367a3-0fd3-4ac3-b5f1-8efad37f4dff None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:39.714122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c0914-d567-4c4b-ab2c-73c3d2ed8874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:39.715585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0914-d567-4c4b-ab2c-73c3d2ed8874 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:39.715861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0914-d567-4c4b-ab2c-73c3d2ed8874 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:39.716129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0914-d567-4c4b-ab2c-73c3d2ed8874 None admin] PATH_INFO: `/v3/projects/e51576e6ceba4091baf7693540cbdf39/users/1b29f6e0fd95426694eb8175f63c9254/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:39.718097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c0914-d567-4c4b-ab2c-73c3d2ed8874 None admin] RBAC: Authorizing `identity:create_grant(project_id=e51576e6ceba4091baf7693540cbdf39, user_id=1b29f6e0fd95426694eb8175f63c9254, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:39.719507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c0914-d567-4c4b-ab2c-73c3d2ed8874 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:39.733131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 594/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:33:39 2022] PUT /identity/v3/projects/e51576e6ceba4091baf7693540cbdf39/users/1b29f6e0fd95426694eb8175f63c9254/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:33:41.878099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a53c-521b-4e94-a194-aa2ed5f062c4 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:41.878619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a53c-521b-4e94-a194-aa2ed5f062c4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:41.878619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a53c-521b-4e94-a194-aa2ed5f062c4 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:41.879931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 599/1193] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:33:41.884966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15e61-aee0-4aa9-885c-80a61d1a6f2f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:41.885367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15e61-aee0-4aa9-885c-80a61d1a6f2f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:41.885516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15e61-aee0-4aa9-885c-80a61d1a6f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:41.902270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d5a15e61-aee0-4aa9-885c-80a61d1a6f2f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:33:41.904054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d5a15e61-aee0-4aa9-885c-80a61d1a6f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:33:41.966836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 595/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:33:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:33:41.989156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a53c-521b-4e94-a194-aa2ed5f062c4 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:42.085119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a53c-521b-4e94-a194-aa2ed5f062c4 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:42.116200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:42.116963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:42.117248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:42.117522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:42.127546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:33:42.135061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:33:42.136169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:33:42.137900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 600/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:33:42.142669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a15e61-aee0-4aa9-885c-80a61d1a6f2f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:42.234210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a15e61-aee0-4aa9-885c-80a61d1a6f2f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:42.266154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:42.266793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:42.267075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:42.267346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:42.268083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:42.268385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:42.269752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:42.277297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 596/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:42.282897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:42.378798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1da22-6798-4e89-bec0-a212b31a033c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:42.410197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:42.410974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:42.411249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:42.411514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] PATH_INFO: `/v3/users/1b29f6e0fd95426694eb8175f63c9254` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:42.412674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] RBAC: Authorizing `identity:get_user(user_id=1b29f6e0fd95426694eb8175f63c9254)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:42.414126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:42.415710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 601/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 12 11:33:42 2022] GET /identity/v3/users/1b29f6e0fd95426694eb8175f63c9254 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:42.421883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:42.514126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7effd04-f08a-4193-9123-d01ddee133b3 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:42.544968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:42.545606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:42.545907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:42.546179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:42.608337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:42.609783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:42.699686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 597/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:33:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:33:42.705425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:42.799402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfba66-991d-4c21-980b-be9ac9048b25 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:42.830562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea59ea-b9d8-4328-9ab2-8993c9dfd8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:42.831389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea59ea-b9d8-4328-9ab2-8993c9dfd8aa None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:42.831675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea59ea-b9d8-4328-9ab2-8993c9dfd8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:42.831951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea59ea-b9d8-4328-9ab2-8993c9dfd8aa None admin] PATH_INFO: `/v3/projects/e51576e6ceba4091baf7693540cbdf39` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:42.833119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea59ea-b9d8-4328-9ab2-8993c9dfd8aa None admin] RBAC: Authorizing `identity:get_project(project_id=e51576e6ceba4091baf7693540cbdf39)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:42.834564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea59ea-b9d8-4328-9ab2-8993c9dfd8aa None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:42.836230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 602/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 12 11:33:42 2022] GET /identity/v3/projects/e51576e6ceba4091baf7693540cbdf39 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:33:42.842807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:33:42.933675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaffac-9230-4348-a3b6-95bacbe4a7bc None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:33:42.965742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6a2f1-9d3d-47f6-91e7-ab0482f6eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:33:42.966305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a2f1-9d3d-47f6-91e7-ab0482f6eea0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:33:42.966581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a2f1-9d3d-47f6-91e7-ab0482f6eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:33:42.966852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a2f1-9d3d-47f6-91e7-ab0482f6eea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:33:42.967665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6a2f1-9d3d-47f6-91e7-ab0482f6eea0 None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=e51576e6ceba4091baf7693540cbdf39, user.id=1b29f6e0fd95426694eb8175f63c9254) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:33:42.967967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6a2f1-9d3d-47f6-91e7-ab0482f6eea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:33:42.969367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6a2f1-9d3d-47f6-91e7-ab0482f6eea0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:33:42.974896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 598/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:33:42 2022] GET /identity/v3/role_assignments?user.id=1b29f6e0fd95426694eb8175f63c9254&scope.project.id=e51576e6ceba4091baf7693540cbdf39&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:43.455369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a588a-b481-4ca1-b78c-d56abd64260f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:43.455951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a588a-b481-4ca1-b78c-d56abd64260f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:43.455951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a588a-b481-4ca1-b78c-d56abd64260f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:43.457261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 603/1201] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:34:43.464106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b35d-7a15-4064-966d-83d106b7efe2 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:43.464630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b35d-7a15-4064-966d-83d106b7efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:43.464717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b35d-7a15-4064-966d-83d106b7efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:43.484778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-fb96b35d-7a15-4064-966d-83d106b7efe2 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:34:43.485005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fb96b35d-7a15-4064-966d-83d106b7efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:34:43.567474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 599/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:34:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:34:43.594778 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a588a-b481-4ca1-b78c-d56abd64260f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:43.727200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a588a-b481-4ca1-b78c-d56abd64260f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:43.770820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:43.771750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:43.772036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:43.772312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:43.785826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:43.787521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:34:43.808270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:43.809318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:43.810401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:34:43.810401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:34:43.810401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:43.810401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:34:43.810401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 604/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:43.817587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b35d-7a15-4064-966d-83d106b7efe2 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:43.934621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b35d-7a15-4064-966d-83d106b7efe2 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:43.977516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87535e-fdf0-40dc-97e9-58dbc99374e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:43.979418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87535e-fdf0-40dc-97e9-58dbc99374e6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:43.979956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87535e-fdf0-40dc-97e9-58dbc99374e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:43.980228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87535e-fdf0-40dc-97e9-58dbc99374e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:43.981155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87535e-fdf0-40dc-97e9-58dbc99374e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:43.981471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87535e-fdf0-40dc-97e9-58dbc99374e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:43.982970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87535e-fdf0-40dc-97e9-58dbc99374e6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:44.001759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 600/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:44.003048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:44.123824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aedc7-fce3-4ee3-a81a-9360cd4086b1 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:44.165490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2048b6-12b9-49fd-875f-050888c0df91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:44.166276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2048b6-12b9-49fd-875f-050888c0df91 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:44.166578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2048b6-12b9-49fd-875f-050888c0df91 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:44.166848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2048b6-12b9-49fd-875f-050888c0df91 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:44.167591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2048b6-12b9-49fd-875f-050888c0df91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:44.169099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2048b6-12b9-49fd-875f-050888c0df91 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:44.195238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 605/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 12 11:34:44 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:34:46.641838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c026ee-dd5b-4266-9ffa-09394f0e0dde None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:46.642402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c026ee-dd5b-4266-9ffa-09394f0e0dde None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:46.642522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c026ee-dd5b-4266-9ffa-09394f0e0dde None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:46.644086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 601/1206] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:34:46.652273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb19d-20fd-46cd-9156-3c2dd97a7126 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:46.652273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb19d-20fd-46cd-9156-3c2dd97a7126 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:46.652273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdb19d-20fd-46cd-9156-3c2dd97a7126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:46.669783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ecfdb19d-20fd-46cd-9156-3c2dd97a7126 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:34:46.671013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ecfdb19d-20fd-46cd-9156-3c2dd97a7126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:34:46.742905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 606/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:34:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:34:46.768473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c026ee-dd5b-4266-9ffa-09394f0e0dde None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:46.885737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c026ee-dd5b-4266-9ffa-09394f0e0dde None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:46.925850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:46.927408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:46.927792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:46.928146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:46.941587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:34:46.950524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:46.951528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:46.952698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 602/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:46.958345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdb19d-20fd-46cd-9156-3c2dd97a7126 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:47.077773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdb19d-20fd-46cd-9156-3c2dd97a7126 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:47.116707 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:47.117380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:47.117663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:47.117972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:47.118749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:47.119060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:47.120565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:47.130440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 607/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:47.136437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:47.247433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e654b5-8cb1-43db-8f6d-edd5f8b265dc None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:47.285028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:47.285886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:47.286306 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:47.286590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:47.298167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:47.299986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:34:47.319198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:47.320159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:47.321110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:34:47.321110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:34:47.321110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:47.321110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:47.328939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:47.329992 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 603/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:47.443997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a287d3b-3755-46a6-b1bd-a1e32dfdf4cd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:47.485008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:47.485915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:47.486266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:47.486645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:47.487564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:47.487997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:47.489603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:47.502524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 608/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:47.508735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:47.619873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d1e2-8dfa-4989-9548-adb32f41faa0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:47.661435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:47.662394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:47.662672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:47.662946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:47.670852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:47.672290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:34:47.687195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:47.688358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:47.689343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 604/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:47.694609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:47.807290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ca4d-7346-4133-9e9f-43803cf2bc84 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:47.845111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:47.845903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:47.846194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:47.846464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:47.847394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:47.847774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:47.849300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:47.868983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 609/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 12 11:34:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:47.875282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:47.998116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d211a-a7a3-455d-8437-b51b1507ffca None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:48.037187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:48.037939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:48.038366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:48.038645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:48.114223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:48.115784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:48.241408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 605/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:34:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:34:48.244239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:48.354684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df41fa6-0f8d-4629-b55d-96f620796e42 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:48.392608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:48.393400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:48.393747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:48.394109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:48.405531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:48.407283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:34:48.425270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:48.426375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:48.432130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:34:48.432130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:34:48.432130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:48.432130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:34:48.432130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 610/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:34:48.432938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:48.538105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad1796-0b22-4968-b83f-0ea315173fc5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:48.573349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:48.574099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:48.574312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:48.574589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:48.575325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:48.575656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:48.577013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:48.588655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 606/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:48.594529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:48.708865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9370d1-7537-4cf6-a126-d9fd7433cf5c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:48.747176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:48.748062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:48.748392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:48.748721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:48.757260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:48.758983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:34:48.773172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:48.775127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:34:48.776300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:34:48.781171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 611/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:48.781393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:48.889035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453abc79-a9b3-49ec-ad9a-bf3eeb7a3d22 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:48.926658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179e7eb-0ac9-4937-ac11-1d16e1732cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:48.927327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179e7eb-0ac9-4937-ac11-1d16e1732cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:48.927606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179e7eb-0ac9-4937-ac11-1d16e1732cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:48.927874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179e7eb-0ac9-4937-ac11-1d16e1732cf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:48.930131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179e7eb-0ac9-4937-ac11-1d16e1732cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:48.931102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179e7eb-0ac9-4937-ac11-1d16e1732cf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:48.933629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179e7eb-0ac9-4937-ac11-1d16e1732cf5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:48.953091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 607/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:48.959892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:49.063262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c76198-0cbd-4ea4-bf05-685bd0fe6aa3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:49.097159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37962-9eaf-46c0-8fff-664f9fc4115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:49.097818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37962-9eaf-46c0-8fff-664f9fc4115f None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:49.098172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37962-9eaf-46c0-8fff-664f9fc4115f None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:49.098375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37962-9eaf-46c0-8fff-664f9fc4115f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:49.099229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37962-9eaf-46c0-8fff-664f9fc4115f None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=aa6eb30499054f368f00f38c946d7c66) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:49.099505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37962-9eaf-46c0-8fff-664f9fc4115f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:49.100942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37962-9eaf-46c0-8fff-664f9fc4115f None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:49.115681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 612/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:34:48 2022] GET /identity/v3/role_assignments?user.id=aa6eb30499054f368f00f38c946d7c66&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:51.426977 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce0e32-a971-455e-a79d-cf4148d78465 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:51.427553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce0e32-a971-455e-a79d-cf4148d78465 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:51.427553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce0e32-a971-455e-a79d-cf4148d78465 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:51.429104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 608/1220] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:34:51.435255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f47f5-5b16-4a90-8ee9-03ab3b2af5ad None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:51.435701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f47f5-5b16-4a90-8ee9-03ab3b2af5ad None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:51.435809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f47f5-5b16-4a90-8ee9-03ab3b2af5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:51.454191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-570f47f5-5b16-4a90-8ee9-03ab3b2af5ad None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:34:51.455392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-570f47f5-5b16-4a90-8ee9-03ab3b2af5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:34:51.533843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 613/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:34:51.551146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce0e32-a971-455e-a79d-cf4148d78465 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:51.663446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce0e32-a971-455e-a79d-cf4148d78465 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:51.707968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:51.708754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:51.709172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:51.709556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:51.722373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:34:51.730843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:51.731843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:51.732844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 609/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:51.738106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f47f5-5b16-4a90-8ee9-03ab3b2af5ad None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:51.840858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f47f5-5b16-4a90-8ee9-03ab3b2af5ad None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:51.879786 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:51.880491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:51.880776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:51.881055 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:51.881914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:51.882226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:51.883645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:51.892658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 614/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:34:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:51.898576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:52.006555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef1491-7445-4422-b9ee-81556698d32a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:52.041635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:52.042468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:52.042745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:52.043020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:52.053852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:52.055846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:34:52.073981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:52.075132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:52.076220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:34:52.076220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:34:52.076220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:52.076220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:52.076220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 610/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:34:52.081217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:52.203826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a844-a5ab-4625-9655-02f9e0c2f9b2 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:52.244504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:52.245178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:52.245460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:52.246426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:52.246546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:52.246791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:52.248147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:52.261859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 615/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:52.268385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:52.385868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004383-7fd6-4669-afa2-ea030bfcbf0e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:52.420792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:52.421752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:52.422116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:52.422396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:52.430818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:52.432271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:34:52.449598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:52.450611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:52.451584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 611/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:52.458128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:52.569410 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657481a-5da9-472f-9d12-916ccc93942d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:52.606192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:52.606855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:52.607129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:52.607395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:52.608226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:52.608534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:52.609967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:52.628506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 616/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 12 11:34:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:52.634885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:52.743808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719555-3b63-4274-aab2-c669a7152d9a None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:52.780652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:52.781930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:52.782389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:52.782941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:52.797620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:52.799766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:34:52.816673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:52.817671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:52.818626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:34:52.818626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:34:52.818626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:52.818626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:52.818626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 612/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:52.824429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:52.937894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866dd75-3c27-4ceb-ba77-d9bcde32c40a None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:52.979175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:52.979971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:52.980269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:52.980528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:52.981352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:52.981712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:52.983297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:52.996613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 617/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:53.002248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:53.110917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b89910-3da0-46c9-abdd-c3e64b02faa4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:53.146424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:53.147435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:53.147725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:53.148092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:53.156636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:53.158139 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:34:53.173323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:53.174797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:53.176066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 613/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:53.180805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:53.286529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a3252-0f27-4e45-bc01-3a4596a82d52 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:53.324916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b7d43-6819-41e4-a6e3-68acc8655603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:53.325720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b7d43-6819-41e4-a6e3-68acc8655603 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:53.326015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b7d43-6819-41e4-a6e3-68acc8655603 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:53.326299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b7d43-6819-41e4-a6e3-68acc8655603 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:53.327081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b7d43-6819-41e4-a6e3-68acc8655603 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:53.327390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b7d43-6819-41e4-a6e3-68acc8655603 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:53.328851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b7d43-6819-41e4-a6e3-68acc8655603 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:53.342279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 618/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:53.348262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:53.455191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7963d-8981-41ad-8c6c-a1288ed96296 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:53.491086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da6fda-7950-4545-bacb-db3a7f4b2445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:53.491984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da6fda-7950-4545-bacb-db3a7f4b2445 None admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:53.492400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da6fda-7950-4545-bacb-db3a7f4b2445 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:53.493288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da6fda-7950-4545-bacb-db3a7f4b2445 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/aa6eb30499054f368f00f38c946d7c66/roles/29b66fdb14844ff6b20ff938a256fd87` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:53.509639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da6fda-7950-4545-bacb-db3a7f4b2445 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=aa6eb30499054f368f00f38c946d7c66, role_id=29b66fdb14844ff6b20ff938a256fd87)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:53.511224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da6fda-7950-4545-bacb-db3a7f4b2445 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:53.524547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 614/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:34:53 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/aa6eb30499054f368f00f38c946d7c66/roles/29b66fdb14844ff6b20ff938a256fd87 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:34:55.766164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3891-0832-4c8b-b10e-46306cf3b3a2 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:55.766674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3891-0832-4c8b-b10e-46306cf3b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:55.766674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3891-0832-4c8b-b10e-46306cf3b3a2 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:55.768217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 619/1233] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:34:55.773982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35f19-fa1d-466c-a592-854eed867c4f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:55.774410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35f19-fa1d-466c-a592-854eed867c4f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:55.774725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35f19-fa1d-466c-a592-854eed867c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:55.793383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e0c35f19-fa1d-466c-a592-854eed867c4f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:34:55.794636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e0c35f19-fa1d-466c-a592-854eed867c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:34:55.862354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 615/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:34:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:34:55.885942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb3891-0832-4c8b-b10e-46306cf3b3a2 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:56.006044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb3891-0832-4c8b-b10e-46306cf3b3a2 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:56.047164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:56.048408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:56.048892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:56.049482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:56.064143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:34:56.073323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:56.074394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:34:56.075250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 620/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 12 11:34:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:56.080487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35f19-fa1d-466c-a592-854eed867c4f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:56.182414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35f19-fa1d-466c-a592-854eed867c4f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:56.222564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:56.223229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:56.223507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:56.223775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:56.224519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:56.224820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:56.226213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:56.235678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 616/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 12 11:34:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:34:56.241347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:56.347797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757358-8d3e-416b-8fd6-765b2e25b86c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:56.385411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:56.386244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:56.386522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:56.386866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:56.398674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:56.400479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:34:56.418537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:56.419584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:56.420522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:34:56.420522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:34:56.420522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:56.420522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:34:56.424396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 621/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 11:34:56.425418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:56.533498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfce8b-c177-489b-9812-e2b6e6c750d5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:56.573064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:56.573753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:56.574040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:56.574314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:56.575037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:56.575348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:56.576702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:56.593682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 617/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:56.594994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:56.699999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb22cb6-812c-4dc6-b756-ece6739fd1ab None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:56.735490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:56.736284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:56.736579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:56.736862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:56.745593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:56.748048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:34:56.763290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:56.764330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:34:56.765350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 622/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:56.771745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:56.876403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496d522-28ba-448c-86f0-2023e03187cb None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:56.911765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:56.912434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:56.912725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:56.913044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:56.913886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:56.914737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:56.916190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:56.937217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 618/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 12 11:34:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:34:56.945294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:57.056075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636c986-0706-45f6-a4c8-6644539298f6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:57.090985 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:57.091628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:57.091912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:57.092186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:57.166576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:57.168377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:57.287864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 623/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:34:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:34:57.289721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:57.396356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44bd73-de31-419a-87d4-c7de3424d066 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:57.436215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:57.437321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:57.437605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:57.437910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:57.451102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:57.452943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:34:57.473555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:57.474719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:57.475876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:34:57.475876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:34:57.475876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:34:57.475876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:57.475876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 619/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:57.482008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:57.590156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862d8d-ceb3-4619-8173-53e23afda8e7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:57.625549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:57.626270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:57.626579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:57.626907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:57.627645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:57.628020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:57.629462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:57.640635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 624/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:34:57.646328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:57.750639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a062-e2f5-4c60-81bd-8249c22941d8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:57.783780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:57.784592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:57.784874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:57.785144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:57.791794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:57.793291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:34:57.807495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:34:57.808586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:34:57.809640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 620/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:34:57.814611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:57.931728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21813a-1fde-4aab-9464-fe70661920f0 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:57.970491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c3493-6ecd-4eb5-87db-f7c0c9eb72b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:57.971156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3493-6ecd-4eb5-87db-f7c0c9eb72b2 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:57.971422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3493-6ecd-4eb5-87db-f7c0c9eb72b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:57.971699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3493-6ecd-4eb5-87db-f7c0c9eb72b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:57.972510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c3493-6ecd-4eb5-87db-f7c0c9eb72b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:57.972799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c3493-6ecd-4eb5-87db-f7c0c9eb72b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:57.974266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c3493-6ecd-4eb5-87db-f7c0c9eb72b2 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:57.987252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 625/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:34:57.993580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:34:58.099611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b7db4-49cc-4225-90dd-62a9e79742c4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:34:58.131946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46ba17-fba0-4150-b094-a9b4f5d9e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:34:58.133192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ba17-fba0-4150-b094-a9b4f5d9e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:34:58.133408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ba17-fba0-4150-b094-a9b4f5d9e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:34:58.133690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ba17-fba0-4150-b094-a9b4f5d9e6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:34:58.134566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46ba17-fba0-4150-b094-a9b4f5d9e6a7 None admin] RBAC: Adding query filter params (role.id=29b66fdb14844ff6b20ff938a256fd87, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=aa6eb30499054f368f00f38c946d7c66) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:34:58.134876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46ba17-fba0-4150-b094-a9b4f5d9e6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:34:58.136279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46ba17-fba0-4150-b094-a9b4f5d9e6a7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:34:58.142147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 621/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:34:57 2022] GET /identity/v3/role_assignments?user.id=aa6eb30499054f368f00f38c946d7c66&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=29b66fdb14844ff6b20ff938a256fd87 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:00.753684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fb3de-387c-441a-8f25-e6581db5039b None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:00.754286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fb3de-387c-441a-8f25-e6581db5039b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:00.754286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fb3de-387c-441a-8f25-e6581db5039b None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:00.755568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 626/1247] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:35:00.761795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694c67-33c0-4e8c-9788-ed713eb6895f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:00.762477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694c67-33c0-4e8c-9788-ed713eb6895f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:00.762477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694c67-33c0-4e8c-9788-ed713eb6895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:00.780268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9c694c67-33c0-4e8c-9788-ed713eb6895f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:35:00.782317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9c694c67-33c0-4e8c-9788-ed713eb6895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:35:00.856319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 622/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:35:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:35:00.884215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fb3de-387c-441a-8f25-e6581db5039b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:01.008872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fb3de-387c-441a-8f25-e6581db5039b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:01.047552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:01.048441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:01.048760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:01.049119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:01.060462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:35:01.068599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:01.069768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:01.076446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 627/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:01.077246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694c67-33c0-4e8c-9788-ed713eb6895f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:01.190767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694c67-33c0-4e8c-9788-ed713eb6895f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:01.230708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:01.231382 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:01.231664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:01.231944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:01.232768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:01.233081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:01.234610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:01.244577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 623/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:01.250581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:01.362436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ca7c6-1d79-4366-b696-391c5e6f84dd None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:01.400651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:01.401533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:01.401851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:01.404143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:01.419185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:01.420952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:35:01.438647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:01.439664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:01.440811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:35:01.440811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:35:01.440811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:01.440811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:01.440811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 628/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:01.447131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:01.553234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a50ab-ad75-48ff-a2c8-ac12e0dff713 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:01.590715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:01.591374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:01.591655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:01.591931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:01.592654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:01.592963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:01.594381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:01.607030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 624/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:35:01.612740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:01.725897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74cecd-5f35-4cd3-84d0-b6b4f01b550c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:01.764050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:01.764875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:01.765155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:01.765437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:01.774152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:01.775632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:35:01.790933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:01.792396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:01.793382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 629/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:01.798971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:01.911550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409326fd-79d4-481f-9ace-afb52beb07fe None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:01.951742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:01.952486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:01.952858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:01.953340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:01.954574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:01.954932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:01.956659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:01.977840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 625/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 12 11:35:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:01.985693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:02.094799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78738a-a38e-4751-aeb6-5e8ec02c8a62 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:02.131498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:02.132688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:02.132993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:02.133315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:02.206335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:02.207702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:02.315516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 630/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:35:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:35:02.321785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:02.432012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3029a-7dda-40c6-926a-58b7724a1cc4 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:02.466737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:02.467444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:02.467726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:02.467998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:02.478534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:02.479955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:35:02.497733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:02.498895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:02.500023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:35:02.500023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:35:02.500023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:02.500023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:02.500023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 626/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:02.505157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:02.608915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76a8f1-64c4-4f84-87e4-43dd4925b1a7 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:02.647785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:02.648453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:02.648732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:02.649025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:02.649815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:02.650128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:02.651521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:02.663050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 631/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:02.669252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:02.772853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f267-20bf-4fe3-ba36-cf722972fddb None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:02.809416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:02.810256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:02.810539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:02.810820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:02.817890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:02.819340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:35:02.834233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:02.836020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:02.842195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 627/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:02.842827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:02.950158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2996-cfba-4b51-b590-9a34d1011211 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:02.988397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9473-6d27-4480-ba8a-8e11304759f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:02.989228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9473-6d27-4480-ba8a-8e11304759f8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:02.989667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9473-6d27-4480-ba8a-8e11304759f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:02.989967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9473-6d27-4480-ba8a-8e11304759f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:02.990930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9473-6d27-4480-ba8a-8e11304759f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:02.991247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9473-6d27-4480-ba8a-8e11304759f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:02.993600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9473-6d27-4480-ba8a-8e11304759f8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:03.009298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 632/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:35:03.015937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:03.120940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2f14f-1d86-4f77-af5b-da10a732db48 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:03.153957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538436-18a7-49de-afaa-f8964101d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:03.154704 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538436-18a7-49de-afaa-f8964101d6af None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:03.154988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538436-18a7-49de-afaa-f8964101d6af None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:03.155260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538436-18a7-49de-afaa-f8964101d6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:03.156092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538436-18a7-49de-afaa-f8964101d6af None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=aa6eb30499054f368f00f38c946d7c66) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:03.156403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538436-18a7-49de-afaa-f8964101d6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:03.157864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538436-18a7-49de-afaa-f8964101d6af None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:03.163905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 628/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:35:03 2022] GET /identity/v3/role_assignments?user.id=aa6eb30499054f368f00f38c946d7c66&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:05.377454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0951bd-512a-49ab-8849-dc17b8609a1d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:05.378040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0951bd-512a-49ab-8849-dc17b8609a1d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:05.378040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0951bd-512a-49ab-8849-dc17b8609a1d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:05.379378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 633/1261] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:35:05.384737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783fe60-5173-440e-8dbb-872ae1f61449 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:05.385161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783fe60-5173-440e-8dbb-872ae1f61449 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:05.385271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783fe60-5173-440e-8dbb-872ae1f61449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:05.401905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4783fe60-5173-440e-8dbb-872ae1f61449 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:35:05.403058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4783fe60-5173-440e-8dbb-872ae1f61449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:35:05.467697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 629/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:35:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:35:05.490569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0951bd-512a-49ab-8849-dc17b8609a1d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:05.587701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0951bd-512a-49ab-8849-dc17b8609a1d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:05.619863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:05.620632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:05.620914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:05.621187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:05.632184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:35:05.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:05.640810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:05.641903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 634/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:05.646933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783fe60-5173-440e-8dbb-872ae1f61449 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:05.740841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783fe60-5173-440e-8dbb-872ae1f61449 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:05.772889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:05.773535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:05.773846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:05.774122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:05.774863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:05.775175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:05.776536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:05.784186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 630/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:05.790492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:05.884549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae227854-f7ea-47e8-9256-1a60b7c46a40 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:05.915662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:05.916679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:05.916847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:05.917270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:05.930333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:05.931892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:35:05.951551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:05.952481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:05.953645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:35:05.953645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:35:05.953645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:05.953645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:05.953645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 635/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:05.959104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:06.060132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffe334-6e30-4e8a-ae55-2de114c8f0c8 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:06.091633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:06.092275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:06.092555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:06.092826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:06.093542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:06.093875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:06.095221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:06.106280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 631/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:06.111908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:06.208279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5148b-c74e-4ef5-81e8-9b171a5641bb None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:06.240580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:06.241903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:06.242189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:06.242464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:06.249652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:06.251120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:35:06.265435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:06.266558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:06.267903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 636/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:06.272334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:06.365578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518ff28-2dd8-4203-8d35-5fa0b124bf18 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:06.400846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:06.400846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:06.400846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:06.400846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:06.401695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:06.401695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:06.401695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:06.424072 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 632/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 12 11:35:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:06.430331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:06.524490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d36641-53ee-4211-abc2-d63dc42404f5 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:06.556622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13454a2e-477b-446d-9793-92261afb994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:06.557394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454a2e-477b-446d-9793-92261afb994c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:06.557674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454a2e-477b-446d-9793-92261afb994c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:06.557981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454a2e-477b-446d-9793-92261afb994c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:06.567866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13454a2e-477b-446d-9793-92261afb994c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:06.569355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13454a2e-477b-446d-9793-92261afb994c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-13454a2e-477b-446d-9793-92261afb994c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:35:06.585907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:06.586955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:06.587991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:35:06.587991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:35:06.587991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:06.587991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:06.587991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 637/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:06.592684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:06.686325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fc423-5f28-43fe-8550-f763586dd2a5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:06.719795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:06.720447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:06.720731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:06.721008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:06.721749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:06.722060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:06.723406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:06.734809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 633/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:06.741884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13454a2e-477b-446d-9793-92261afb994c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:06.840369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13454a2e-477b-446d-9793-92261afb994c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:06.872530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:06.873307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:06.873590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:06.873929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:06.880212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:06.882207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:35:06.896021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:06.896893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:06.897872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 638/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:06.902927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:07.006603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf2cb-2cfd-4b25-b340-36011273376f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:07.037654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646db3-32cd-480f-8fba-ca7ff2f47b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:07.038345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646db3-32cd-480f-8fba-ca7ff2f47b3c None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:07.038625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646db3-32cd-480f-8fba-ca7ff2f47b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:07.038897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646db3-32cd-480f-8fba-ca7ff2f47b3c None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:07.039669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646db3-32cd-480f-8fba-ca7ff2f47b3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:07.039975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646db3-32cd-480f-8fba-ca7ff2f47b3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:07.041390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646db3-32cd-480f-8fba-ca7ff2f47b3c None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:07.052704 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 634/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:07.059121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:07.152900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9677-4828-4b34-b7ae-1212243082d6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:07.183854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bc49c-4499-4f40-9159-3520c8d6af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:07.184709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc49c-4499-4f40-9159-3520c8d6af93 None admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:07.184989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc49c-4499-4f40-9159-3520c8d6af93 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:07.185263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc49c-4499-4f40-9159-3520c8d6af93 None admin] PATH_INFO: `/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/aa6eb30499054f368f00f38c946d7c66/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:07.187202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bc49c-4499-4f40-9159-3520c8d6af93 None admin] RBAC: Authorizing `identity:create_grant(project_id=1174d81ccf71439ebf50adeb716b4fac, user_id=aa6eb30499054f368f00f38c946d7c66, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:07.188623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bc49c-4499-4f40-9159-3520c8d6af93 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:07.201598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 639/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 12 11:35:07 2022] PUT /identity/v3/projects/1174d81ccf71439ebf50adeb716b4fac/users/aa6eb30499054f368f00f38c946d7c66/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:35:09.358675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303db3b-e5a6-4d79-8be2-e7fbc2d90cbf None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:09.359231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303db3b-e5a6-4d79-8be2-e7fbc2d90cbf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:09.359231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303db3b-e5a6-4d79-8be2-e7fbc2d90cbf None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:09.360556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 635/1274] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:35:09.365607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a8d36-52b9-4dd8-925f-fa7aa70f1f2e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:09.366013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a8d36-52b9-4dd8-925f-fa7aa70f1f2e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:09.366187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a8d36-52b9-4dd8-925f-fa7aa70f1f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:09.382849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ce6a8d36-52b9-4dd8-925f-fa7aa70f1f2e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:35:09.384010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ce6a8d36-52b9-4dd8-925f-fa7aa70f1f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:35:09.446293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 640/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:35:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:35:09.468692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303db3b-e5a6-4d79-8be2-e7fbc2d90cbf None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:09.563462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303db3b-e5a6-4d79-8be2-e7fbc2d90cbf None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:09.594474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:09.595237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:09.595514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:09.595787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:09.605775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 11:35:09.613274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:09.614431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:09.615345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 636/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 12 11:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:09.620781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a8d36-52b9-4dd8-925f-fa7aa70f1f2e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:09.714077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a8d36-52b9-4dd8-925f-fa7aa70f1f2e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:09.745552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:09.746225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:09.746504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:09.746775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:09.747510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:09.747812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:09.749166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:09.756716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 641/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 12 11:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:09.762148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:09.856955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5998f-9363-4b15-aae6-850c026ddccd None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:09.887919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:09.888630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:09.888907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:09.889173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:09.899773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:09.901200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:35:09.918033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:09.919195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:09.920323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:35:09.920323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:35:09.920323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:09.920323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:09.920323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 637/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:09.925950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:10.032172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ff29-a7a8-4bf6-96c9-6683cf17b5b6 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:10.063260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:10.063898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:10.064173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:10.064444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:10.065155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:10.065456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:10.066848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:10.078527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 642/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:10.084183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:10.178055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047966-c541-43a7-a30d-56df977ffdf0 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:10.210283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:10.211068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:10.211349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:10.211624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:10.218802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:10.220220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 11:35:10.237053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:10.238254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:10.239472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 638/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:10.243982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:10.337335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc7a0-48ed-4aa7-ac53-d4c9582a931d None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:10.368814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:10.369455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:10.369757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:10.370031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:10.370851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:10.371151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:10.372553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:10.388888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 643/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 12 11:35:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:10.394393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:10.492819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f72e-5f20-4619-aaf0-2dfe11532ce2 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:10.524395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:10.525030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:10.525311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:10.525584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:10.589432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:10.590909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:10.681431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 639/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 12 11:35:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 11:35:10.687137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:10.788348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd81c-3e6f-4c06-96eb-1b219e12137b None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:10.820102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:10.821135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:10.821417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:10.821694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:10.831125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:10.832563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 11:35:10.849843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:10.850908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:10.852195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 11:35:10.852195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 11:35:10.852195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 11:35:10.852195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:10.852195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 644/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:10.856595 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:10.955244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6ec0a-4af6-4ed1-b6ce-fb243e9d0bc6 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:10.986628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:10.987272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:10.987548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:10.987813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:10.988518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:10.988819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:10.990200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:11.001263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 640/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 12 11:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:11.006921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:11.106148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fff697-a131-4404-9c01-87b7d8b994b3 None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:11.137766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:11.138534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:11.138814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:11.139083 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:11.145316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:11.146808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 11:35:11.159913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application with Lock( May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:11.160948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: ERROR keystone.server.flask.application May 12 11:35:11.162091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 645/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 12 11:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:11.167298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:11.261667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294d29f-f4f5-45df-8dd1-9ef085956c6e None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:11.292607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5addaa-dea1-4b56-ad05-0bc1244033f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:11.293242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5addaa-dea1-4b56-ad05-0bc1244033f9 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:11.293524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5addaa-dea1-4b56-ad05-0bc1244033f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:11.293830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5addaa-dea1-4b56-ad05-0bc1244033f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:11.294613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5addaa-dea1-4b56-ad05-0bc1244033f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:11.294921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5addaa-dea1-4b56-ad05-0bc1244033f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:11.296329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5addaa-dea1-4b56-ad05-0bc1244033f9 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:11.308178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 641/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 12 11:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:11.313925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:11.413268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35b5b2-d637-4bab-8853-8ccdcf2b686c None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:11.446172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b200c2-2c7c-4573-a3b8-76853417ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:11.446812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b200c2-2c7c-4573-a3b8-76853417ba8c None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:11.447099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b200c2-2c7c-4573-a3b8-76853417ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:11.447378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b200c2-2c7c-4573-a3b8-76853417ba8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:11.448206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b200c2-2c7c-4573-a3b8-76853417ba8c None admin] RBAC: Adding query filter params (role.id=714f5eae52e240ca9b09d49c36f10b2f, scope.project.id=1174d81ccf71439ebf50adeb716b4fac, user.id=aa6eb30499054f368f00f38c946d7c66) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:11.448519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b200c2-2c7c-4573-a3b8-76853417ba8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:11.449996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b200c2-2c7c-4573-a3b8-76853417ba8c None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:11.455763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 646/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 12 11:35:11 2022] GET /identity/v3/role_assignments?user.id=aa6eb30499054f368f00f38c946d7c66&scope.project.id=1174d81ccf71439ebf50adeb716b4fac&role.id=714f5eae52e240ca9b09d49c36f10b2f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:13.639909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3dbe-f622-4f54-8be6-9d689d452561 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:13.640441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3dbe-f622-4f54-8be6-9d689d452561 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:13.640441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3dbe-f622-4f54-8be6-9d689d452561 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:13.641939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 642/1288] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:35:13.647628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ec4d-6610-4c06-b8ee-dff13f6b498d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:13.648064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ec4d-6610-4c06-b8ee-dff13f6b498d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:13.648170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ec4d-6610-4c06-b8ee-dff13f6b498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:13.664957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8f47ec4d-6610-4c06-b8ee-dff13f6b498d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:35:13.666165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8f47ec4d-6610-4c06-b8ee-dff13f6b498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:35:13.730327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 647/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:35:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:35:13.752170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac3dbe-f622-4f54-8be6-9d689d452561 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:13.846180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac3dbe-f622-4f54-8be6-9d689d452561 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:13.876747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:13.877515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:13.877819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:13.878090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:13.878726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:13.880064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:13.891838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:13.893061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:13.894154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 643/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:35:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:13.899462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ec4d-6610-4c06-b8ee-dff13f6b498d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:14.004512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ec4d-6610-4c06-b8ee-dff13f6b498d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:14.036521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95df41e-1346-471d-beb6-7d161ad69779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:14.037675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df41e-1346-471d-beb6-7d161ad69779 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:14.037977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df41e-1346-471d-beb6-7d161ad69779 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:14.038247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df41e-1346-471d-beb6-7d161ad69779 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:14.038940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95df41e-1346-471d-beb6-7d161ad69779 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:14.039241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95df41e-1346-471d-beb6-7d161ad69779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:14.040598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95df41e-1346-471d-beb6-7d161ad69779 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:14.045590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 648/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 12 11:35:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:14.051943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:14.147240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e3e61-f739-4e88-ae98-221c0c2b0186 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:14.178196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51eef9-1eb3-448a-a74f-e5f4e83581f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:14.178830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51eef9-1eb3-448a-a74f-e5f4e83581f7 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:14.179110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51eef9-1eb3-448a-a74f-e5f4e83581f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:14.179386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51eef9-1eb3-448a-a74f-e5f4e83581f7 None admin] PATH_INFO: `/v3/services` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:14.180078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51eef9-1eb3-448a-a74f-e5f4e83581f7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:14.180382 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51eef9-1eb3-448a-a74f-e5f4e83581f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:14.181747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51eef9-1eb3-448a-a74f-e5f4e83581f7 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:14.185991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 644/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 12 11:35:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:16.379478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a96581-b382-4a6b-9383-7dfd12c98d23 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:16.380077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a96581-b382-4a6b-9383-7dfd12c98d23 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:16.380077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a96581-b382-4a6b-9383-7dfd12c98d23 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:16.381436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 649/1293] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:35:16.386622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cbe4a-30d9-490b-b66f-a4fea7f2536d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:16.387034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cbe4a-30d9-490b-b66f-a4fea7f2536d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:16.387182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cbe4a-30d9-490b-b66f-a4fea7f2536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:16.404081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-414cbe4a-30d9-490b-b66f-a4fea7f2536d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:35:16.405253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-414cbe4a-30d9-490b-b66f-a4fea7f2536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:35:16.468043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 645/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:35:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 11:35:16.490837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a96581-b382-4a6b-9383-7dfd12c98d23 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:16.586389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a96581-b382-4a6b-9383-7dfd12c98d23 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:16.618128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee66e11-008f-47c7-92ab-c6ea9240e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:16.618768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66e11-008f-47c7-92ab-c6ea9240e579 None admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:16.619054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66e11-008f-47c7-92ab-c6ea9240e579 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:16.619331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66e11-008f-47c7-92ab-c6ea9240e579 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:16.620049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66e11-008f-47c7-92ab-c6ea9240e579 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:16.621414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66e11-008f-47c7-92ab-c6ea9240e579 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:16.634624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 650/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 12 11:35:16 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:35:18.852335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f2f4-84f0-4d8f-8d79-e090acac6b3b None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:18.852832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f2f4-84f0-4d8f-8d79-e090acac6b3b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:18.852832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f2f4-84f0-4d8f-8d79-e090acac6b3b None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:18.854219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 646/1296] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:35:18.859465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd519f9-56e0-4bb5-ac10-2a003423f5e9 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:18.859860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd519f9-56e0-4bb5-ac10-2a003423f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:18.860016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd519f9-56e0-4bb5-ac10-2a003423f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:18.876707 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-1dd519f9-56e0-4bb5-ac10-2a003423f5e9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:35:18.877939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1dd519f9-56e0-4bb5-ac10-2a003423f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:35:18.947605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 651/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:35:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:35:18.970378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f2f4-84f0-4d8f-8d79-e090acac6b3b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:19.065193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f2f4-84f0-4d8f-8d79-e090acac6b3b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:19.097538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:19.098342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:19.098626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:19.098904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:19.099593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:19.100968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:19.112449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:19.113625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:19.114724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 647/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:35:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:19.119718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd519f9-56e0-4bb5-ac10-2a003423f5e9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:19.212154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd519f9-56e0-4bb5-ac10-2a003423f5e9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:19.244885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:19.245523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:19.245851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:19.246118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:19.246813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:19.247112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:19.248461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:19.253376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 652/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 12 11:35:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:19.259360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:19.352991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abcdd0-8539-4766-8d39-5296780a5ff5 None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:19.384664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd7ee-65ea-42aa-be5d-f8c95cb6468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:19.385239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd7ee-65ea-42aa-be5d-f8c95cb6468b None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:19.385521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd7ee-65ea-42aa-be5d-f8c95cb6468b None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:19.385823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd7ee-65ea-42aa-be5d-f8c95cb6468b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:19.386606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd7ee-65ea-42aa-be5d-f8c95cb6468b None admin] RBAC: Adding query filter params (interface=public, service_id=49131165f2d943b9b13f385a8a30bfae, region_id=RegionOne) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:19.386926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd7ee-65ea-42aa-be5d-f8c95cb6468b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:19.388287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd7ee-65ea-42aa-be5d-f8c95cb6468b None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:19.393050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 648/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 12 11:35:19 2022] GET /identity/v3/endpoints?service_id=49131165f2d943b9b13f385a8a30bfae&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:19.398522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:19.493328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0802f4-9060-4a40-90e2-b24ec30139eb None admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:19.524981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d156d-ad70-458f-8cb3-12addd1616d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:19.525628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d156d-ad70-458f-8cb3-12addd1616d7 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:19.525943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d156d-ad70-458f-8cb3-12addd1616d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:19.526220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d156d-ad70-458f-8cb3-12addd1616d7 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:19.526896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d156d-ad70-458f-8cb3-12addd1616d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:19.528256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d156d-ad70-458f-8cb3-12addd1616d7 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:19.534758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 653/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 12 11:35:19 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:35:21.732672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88fd10-4c19-4411-9984-2a88681f5895 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:21.733195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88fd10-4c19-4411-9984-2a88681f5895 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:21.733313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88fd10-4c19-4411-9984-2a88681f5895 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:21.734612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 649/1302] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:35:21.740339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6af8f-9b1e-42f5-bdee-4eb78ab8cdfd None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:21.740710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6af8f-9b1e-42f5-bdee-4eb78ab8cdfd None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:21.740895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6af8f-9b1e-42f5-bdee-4eb78ab8cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:21.757823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ade6af8f-9b1e-42f5-bdee-4eb78ab8cdfd None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:35:21.758911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ade6af8f-9b1e-42f5-bdee-4eb78ab8cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:35:21.820626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 654/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:35:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 11:35:21.842874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88fd10-4c19-4411-9984-2a88681f5895 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:21.947611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88fd10-4c19-4411-9984-2a88681f5895 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:21.979642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:21.980422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:21.980703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:21.980979 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:21.981624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:21.983007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 11:35:21.994928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 11:35:21.996091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.get_or_create( May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application with Lock( May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self._enter() May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application return self.creator() May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application created_value = creator( May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: ERROR keystone.server.flask.application May 12 11:35:21.997215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 650/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 12 11:35:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 11:35:22.002232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6af8f-9b1e-42f5-bdee-4eb78ab8cdfd None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:22.093793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6af8f-9b1e-42f5-bdee-4eb78ab8cdfd None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:22.126358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c0de-fed4-454b-8227-4f195f13f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:22.126997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c0de-fed4-454b-8227-4f195f13f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:22.127279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c0de-fed4-454b-8227-4f195f13f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:22.127556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c0de-fed4-454b-8227-4f195f13f2b8 None admin] PATH_INFO: `/v3/services` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:22.128254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c0de-fed4-454b-8227-4f195f13f2b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:35:22.128558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c0de-fed4-454b-8227-4f195f13f2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:22.129947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c0de-fed4-454b-8227-4f195f13f2b8 None admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:22.134802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 655/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 12 11:35:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:35:22.140417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:35:22.240259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265103fc-e314-4829-ac21-41b2f5350f9f None admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:35:22.275693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff191562-8215-4762-80e8-a3c974e58caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:35:22.276332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191562-8215-4762-80e8-a3c974e58caf None admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:35:22.276613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191562-8215-4762-80e8-a3c974e58caf None admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:35:22.276888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191562-8215-4762-80e8-a3c974e58caf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:35:22.277613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff191562-8215-4762-80e8-a3c974e58caf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:35:22.278994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff191562-8215-4762-80e8-a3c974e58caf None admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:35:22.300824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 651/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 12 11:35:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:36:25.747766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf3be9-f8b2-4a1d-bc33-bc973bf6eabf None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:25.748759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf3be9-f8b2-4a1d-bc33-bc973bf6eabf None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:25.749250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf3be9-f8b2-4a1d-bc33-bc973bf6eabf None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:25.754924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 656/1307] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:25.756217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b5c1-a60d-4b27-8953-87b926db529d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:25.757077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b5c1-a60d-4b27-8953-87b926db529d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:25.757577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b5c1-a60d-4b27-8953-87b926db529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:25.842813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0ea3b5c1-a60d-4b27-8953-87b926db529d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:25.844446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0ea3b5c1-a60d-4b27-8953-87b926db529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:25.960097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 652/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:36:26.011340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c48b-2390-4a9b-abc5-77ed2843328c None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:26.011732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c48b-2390-4a9b-abc5-77ed2843328c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:26.012198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c48b-2390-4a9b-abc5-77ed2843328c None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:26.014440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 657/1309] 10.222.0.58 () {54 vars in 964 bytes} [Thu May 12 11:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:26.020893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37544e6-4775-4fe3-b5ae-c3500ff620e3 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:26.021184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37544e6-4775-4fe3-b5ae-c3500ff620e3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:26.021458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37544e6-4775-4fe3-b5ae-c3500ff620e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:26.111873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c37544e6-4775-4fe3-b5ae-c3500ff620e3 None None] MFA Rules not processed for user `9c1c4e1fe220486ab672b3dea6ffdfec`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:26.113147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c37544e6-4775-4fe3-b5ae-c3500ff620e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:26.199530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 653/1310] 10.222.0.58 () {58 vars in 1061 bytes} [Thu May 12 11:36:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:26.208378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37c48b-2390-4a9b-abc5-77ed2843328c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:26.210127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-bf37c48b-2390-4a9b-abc5-77ed2843328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:26.332318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37c48b-2390-4a9b-abc5-77ed2843328c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:26.405385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73055e-58c3-4600-970c-4625f629cc84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:26.406401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73055e-58c3-4600-970c-4625f629cc84 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:26.406864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73055e-58c3-4600-970c-4625f629cc84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:26.407319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73055e-58c3-4600-970c-4625f629cc84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:26.409788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5f73055e-58c3-4600-970c-4625f629cc84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:26.518521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73055e-58c3-4600-970c-4625f629cc84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:26.519996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73055e-58c3-4600-970c-4625f629cc84 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:26.539010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 658/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:29.063772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415300f3-7c94-4efc-bdac-4beb9e3ea434 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:29.064316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415300f3-7c94-4efc-bdac-4beb9e3ea434 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:29.064445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415300f3-7c94-4efc-bdac-4beb9e3ea434 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:29.065756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 654/1312] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:29.071736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e35a-a08e-413d-b113-48358190e410 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:29.072202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e35a-a08e-413d-b113-48358190e410 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:29.072286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e35a-a08e-413d-b113-48358190e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:29.146501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6fd5e35a-a08e-413d-b113-48358190e410 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:29.147710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6fd5e35a-a08e-413d-b113-48358190e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:29.248702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 659/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:29.288215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415300f3-7c94-4efc-bdac-4beb9e3ea434 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:29.290955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-415300f3-7c94-4efc-bdac-4beb9e3ea434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:29.405109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415300f3-7c94-4efc-bdac-4beb9e3ea434 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:29.495387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218ef2-dbd1-43a1-a4f8-536c0c9141ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:29.499981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218ef2-dbd1-43a1-a4f8-536c0c9141ea service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:29.499981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218ef2-dbd1-43a1-a4f8-536c0c9141ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:29.499981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218ef2-dbd1-43a1-a4f8-536c0c9141ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:29.500311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-37218ef2-dbd1-43a1-a4f8-536c0c9141ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:29.615388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218ef2-dbd1-43a1-a4f8-536c0c9141ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:29.616852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218ef2-dbd1-43a1-a4f8-536c0c9141ea service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:29.637848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 655/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:32.208862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7477-0dae-4802-ac06-d03b61f752c9 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:32.209479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7477-0dae-4802-ac06-d03b61f752c9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:32.209479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7477-0dae-4802-ac06-d03b61f752c9 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:32.210829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 660/1315] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:32.215909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c7b0-4d28-4a71-846d-b72611c60622 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:32.216361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c7b0-4d28-4a71-846d-b72611c60622 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:32.216466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c7b0-4d28-4a71-846d-b72611c60622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:32.278976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f262c7b0-4d28-4a71-846d-b72611c60622 None None] MFA Rules not processed for user `a99077e3219448dd982cddd4372f35b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:32.280149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f262c7b0-4d28-4a71-846d-b72611c60622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:32.370922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 656/1316] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:32.410055 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a7477-0dae-4802-ac06-d03b61f752c9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:32.411614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-714a7477-0dae-4802-ac06-d03b61f752c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:32.511178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a7477-0dae-4802-ac06-d03b61f752c9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:32.579927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8ce9e-2697-4094-8dc6-b1686127cf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:32.580565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8ce9e-2697-4094-8dc6-b1686127cf95 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:32.580844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8ce9e-2697-4094-8dc6-b1686127cf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:32.581120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8ce9e-2697-4094-8dc6-b1686127cf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:32.582758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2ca8ce9e-2697-4094-8dc6-b1686127cf95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:32.687079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8ce9e-2697-4094-8dc6-b1686127cf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:32.688530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8ce9e-2697-4094-8dc6-b1686127cf95 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:32.710062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 661/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:35.444617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080f65f-39c2-42dd-9f08-d7b371772ef7 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:35.445186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080f65f-39c2-42dd-9f08-d7b371772ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:35.445186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080f65f-39c2-42dd-9f08-d7b371772ef7 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:35.446587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 657/1318] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:35.451894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3176b4-4a8e-47dd-b758-f6094ec707dc None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:35.452315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3176b4-4a8e-47dd-b758-f6094ec707dc None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:35.452446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3176b4-4a8e-47dd-b758-f6094ec707dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:35.514372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5f3176b4-4a8e-47dd-b758-f6094ec707dc None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:35.515563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5f3176b4-4a8e-47dd-b758-f6094ec707dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:35.607809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 662/1319] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:35.658971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966384-d5fa-4af9-9a93-3ea4eeb8a405 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:35.659254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966384-d5fa-4af9-9a93-3ea4eeb8a405 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:35.659527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966384-d5fa-4af9-9a93-3ea4eeb8a405 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:35.660934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 658/1320] 10.222.0.58 () {54 vars in 964 bytes} [Thu May 12 11:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:35.666880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6f06-c7ab-4449-8fb3-7acc4659c9a1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:35.667173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6f06-c7ab-4449-8fb3-7acc4659c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:35.667454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6f06-c7ab-4449-8fb3-7acc4659c9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:35.746500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-94ba6f06-c7ab-4449-8fb3-7acc4659c9a1 None None] MFA Rules not processed for user `9c1c4e1fe220486ab672b3dea6ffdfec`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:35.747711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-94ba6f06-c7ab-4449-8fb3-7acc4659c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:35.820341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 663/1321] 10.222.0.58 () {58 vars in 1061 bytes} [Thu May 12 11:36:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:35.829280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966384-d5fa-4af9-9a93-3ea4eeb8a405 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:35.831494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e4966384-d5fa-4af9-9a93-3ea4eeb8a405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:35.930089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966384-d5fa-4af9-9a93-3ea4eeb8a405 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:36.006925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407602cb-6453-4ecd-9663-d4c3927a15d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:36.007487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407602cb-6453-4ecd-9663-d4c3927a15d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:36.007773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407602cb-6453-4ecd-9663-d4c3927a15d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:36.008048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407602cb-6453-4ecd-9663-d4c3927a15d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:36.009726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-407602cb-6453-4ecd-9663-d4c3927a15d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:36.114481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407602cb-6453-4ecd-9663-d4c3927a15d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:36.115903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407602cb-6453-4ecd-9663-d4c3927a15d5 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:36.133905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 659/1322] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:36:39.420867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba6b1d-cae8-48e9-9d40-79aaa281749a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:39.421426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba6b1d-cae8-48e9-9d40-79aaa281749a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:39.421540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba6b1d-cae8-48e9-9d40-79aaa281749a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:39.422867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 664/1323] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:39.428841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c70787-ac08-427e-a18c-60fdcc9180c7 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:39.429259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c70787-ac08-427e-a18c-60fdcc9180c7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:39.429378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c70787-ac08-427e-a18c-60fdcc9180c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:39.492845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f9c70787-ac08-427e-a18c-60fdcc9180c7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:39.494079 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f9c70787-ac08-427e-a18c-60fdcc9180c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:39.586775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 660/1324] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:39.622659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba6b1d-cae8-48e9-9d40-79aaa281749a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:39.624184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-19ba6b1d-cae8-48e9-9d40-79aaa281749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:39.726892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba6b1d-cae8-48e9-9d40-79aaa281749a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:39.796487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce297-1bf8-4323-8919-4b2c2b805817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:39.797129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce297-1bf8-4323-8919-4b2c2b805817 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:39.797406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce297-1bf8-4323-8919-4b2c2b805817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:39.797674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce297-1bf8-4323-8919-4b2c2b805817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:39.799339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-42fce297-1bf8-4323-8919-4b2c2b805817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:39.902084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce297-1bf8-4323-8919-4b2c2b805817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:39.903516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce297-1bf8-4323-8919-4b2c2b805817 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:39.921813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 665/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:42.206194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0d16c-9e5c-42d7-8805-66a587ddd865 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:42.206723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0d16c-9e5c-42d7-8805-66a587ddd865 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:42.206723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0d16c-9e5c-42d7-8805-66a587ddd865 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:42.208038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 661/1326] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:42.213376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015c68-ed25-41a9-a8f4-0c1fc723da77 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:42.213815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015c68-ed25-41a9-a8f4-0c1fc723da77 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:42.213970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015c68-ed25-41a9-a8f4-0c1fc723da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:42.276737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0a015c68-ed25-41a9-a8f4-0c1fc723da77 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:42.277976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0a015c68-ed25-41a9-a8f4-0c1fc723da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:42.372488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 666/1327] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:42.407248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0d16c-9e5c-42d7-8805-66a587ddd865 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:42.409364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-97d0d16c-9e5c-42d7-8805-66a587ddd865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:42.516019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0d16c-9e5c-42d7-8805-66a587ddd865 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:42.586261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e6d8-84b3-4330-ac82-e64a13800978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:42.586908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e6d8-84b3-4330-ac82-e64a13800978 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:42.587188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e6d8-84b3-4330-ac82-e64a13800978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:42.587458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e6d8-84b3-4330-ac82-e64a13800978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:42.589085 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fdf6e6d8-84b3-4330-ac82-e64a13800978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:42.694748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6e6d8-84b3-4330-ac82-e64a13800978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:42.696209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6e6d8-84b3-4330-ac82-e64a13800978 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:42.714371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 662/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:45.000818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235d74-bb41-4d21-9452-a2c47fe656b9 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:45.002025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235d74-bb41-4d21-9452-a2c47fe656b9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:45.002025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235d74-bb41-4d21-9452-a2c47fe656b9 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:45.003343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 667/1329] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:45.008628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55ea4-3d02-458c-adf1-acccc6263db1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:45.009056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55ea4-3d02-458c-adf1-acccc6263db1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:45.009187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55ea4-3d02-458c-adf1-acccc6263db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:45.071452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-54f55ea4-3d02-458c-adf1-acccc6263db1 None None] MFA Rules not processed for user `a99077e3219448dd982cddd4372f35b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:45.072680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-54f55ea4-3d02-458c-adf1-acccc6263db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:45.164256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 663/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:45.201631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e235d74-bb41-4d21-9452-a2c47fe656b9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:45.203225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7e235d74-bb41-4d21-9452-a2c47fe656b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:45.305458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e235d74-bb41-4d21-9452-a2c47fe656b9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:45.378983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad75e-a39e-46a5-b699-a2868a0feba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:45.379631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad75e-a39e-46a5-b699-a2868a0feba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:45.379914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad75e-a39e-46a5-b699-a2868a0feba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:45.380187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad75e-a39e-46a5-b699-a2868a0feba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:45.381850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-95fad75e-a39e-46a5-b699-a2868a0feba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:45.486726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad75e-a39e-46a5-b699-a2868a0feba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:45.488178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad75e-a39e-46a5-b699-a2868a0feba5 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:45.506353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 668/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:47.961776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1664f9b-a267-4304-96aa-5157841e60e6 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:47.962272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1664f9b-a267-4304-96aa-5157841e60e6 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:47.962474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1664f9b-a267-4304-96aa-5157841e60e6 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:47.963871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 664/1332] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:47.969503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336917-83b4-4606-ab38-185d9f33411b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:47.970008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336917-83b4-4606-ab38-185d9f33411b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:47.970809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336917-83b4-4606-ab38-185d9f33411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:48.037173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0a336917-83b4-4606-ab38-185d9f33411b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:48.038420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0a336917-83b4-4606-ab38-185d9f33411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:48.131698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 669/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:48.166643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1664f9b-a267-4304-96aa-5157841e60e6 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:48.168120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a1664f9b-a267-4304-96aa-5157841e60e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:48.267962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1664f9b-a267-4304-96aa-5157841e60e6 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:48.339665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6094d7-57ba-4eb9-bb75-cc4b3e46cac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:48.340304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6094d7-57ba-4eb9-bb75-cc4b3e46cac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:48.340581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6094d7-57ba-4eb9-bb75-cc4b3e46cac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:48.340847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6094d7-57ba-4eb9-bb75-cc4b3e46cac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:48.342513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8a6094d7-57ba-4eb9-bb75-cc4b3e46cac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:48.448037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6094d7-57ba-4eb9-bb75-cc4b3e46cac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:48.449406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6094d7-57ba-4eb9-bb75-cc4b3e46cac4 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:48.466977 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 665/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:50.751719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be70aa-42c2-4aa9-aeb0-6b2e9bfa062c None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:50.752259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be70aa-42c2-4aa9-aeb0-6b2e9bfa062c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:50.752259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be70aa-42c2-4aa9-aeb0-6b2e9bfa062c None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:50.753619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 670/1335] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:50.759097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b738-e532-4764-8836-e68c5f6302d7 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:50.759507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b738-e532-4764-8836-e68c5f6302d7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:50.759693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b738-e532-4764-8836-e68c5f6302d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:50.827028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9dd3b738-e532-4764-8836-e68c5f6302d7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:50.828259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9dd3b738-e532-4764-8836-e68c5f6302d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:50.923371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 666/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:50.964143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be70aa-42c2-4aa9-aeb0-6b2e9bfa062c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:50.965670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-68be70aa-42c2-4aa9-aeb0-6b2e9bfa062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:51.063963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be70aa-42c2-4aa9-aeb0-6b2e9bfa062c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:51.132866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7127bff-4059-492e-94a7-206da66c1964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:51.133502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127bff-4059-492e-94a7-206da66c1964 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:51.133846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127bff-4059-492e-94a7-206da66c1964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:51.134127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127bff-4059-492e-94a7-206da66c1964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:51.135746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f7127bff-4059-492e-94a7-206da66c1964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:51.239535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7127bff-4059-492e-94a7-206da66c1964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:51.240962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7127bff-4059-492e-94a7-206da66c1964 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:51.259261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 671/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:53.859338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304ce07-e559-4445-b9ee-4e58153c096c None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:53.859855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304ce07-e559-4445-b9ee-4e58153c096c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:53.859971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304ce07-e559-4445-b9ee-4e58153c096c None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:53.861243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 667/1338] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:53.866387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82082-cacb-47ef-9774-0895d7807317 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:53.866837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82082-cacb-47ef-9774-0895d7807317 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:53.866976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82082-cacb-47ef-9774-0895d7807317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:53.930338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8fa82082-cacb-47ef-9774-0895d7807317 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:53.931881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8fa82082-cacb-47ef-9774-0895d7807317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:54.029664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 672/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:54.064754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304ce07-e559-4445-b9ee-4e58153c096c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:54.066916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f304ce07-e559-4445-b9ee-4e58153c096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:54.164892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304ce07-e559-4445-b9ee-4e58153c096c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:54.233933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcadd27-c98b-4100-963c-0067a2738b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:54.234565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadd27-c98b-4100-963c-0067a2738b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:54.234840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadd27-c98b-4100-963c-0067a2738b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:54.235108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadd27-c98b-4100-963c-0067a2738b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:54.236717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-cfcadd27-c98b-4100-963c-0067a2738b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:54.342303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcadd27-c98b-4100-963c-0067a2738b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:54.343661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcadd27-c98b-4100-963c-0067a2738b10 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:54.361134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 668/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:36:58.580863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103243f-0584-4ccf-bdf8-b6eb681bf411 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:58.581370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103243f-0584-4ccf-bdf8-b6eb681bf411 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:58.581370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103243f-0584-4ccf-bdf8-b6eb681bf411 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:58.582748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 673/1341] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:36:58.588231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0f93-7aab-48fd-a3bf-02954dea973b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:58.588642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0f93-7aab-48fd-a3bf-02954dea973b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:58.588796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0f93-7aab-48fd-a3bf-02954dea973b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:58.657027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-2b5a0f93-7aab-48fd-a3bf-02954dea973b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:36:58.658180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2b5a0f93-7aab-48fd-a3bf-02954dea973b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:58.760898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 669/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:36:58.803252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103243f-0584-4ccf-bdf8-b6eb681bf411 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:36:58.805377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b103243f-0584-4ccf-bdf8-b6eb681bf411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:36:58.907742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103243f-0584-4ccf-bdf8-b6eb681bf411 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:36:58.911751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c4b22-2aca-4fe1-afa3-81493f5b9923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:36:58.912392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4b22-2aca-4fe1-afa3-81493f5b9923 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:36:58.912676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4b22-2aca-4fe1-afa3-81493f5b9923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:36:58.912955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4b22-2aca-4fe1-afa3-81493f5b9923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:36:58.921806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c4b22-2aca-4fe1-afa3-81493f5b9923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:36:58.923235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c4b22-2aca-4fe1-afa3-81493f5b9923 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:36:58.933834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 674/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:01.717558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb258-22f5-43c0-9afc-8e0067d2e284 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:01.718215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb258-22f5-43c0-9afc-8e0067d2e284 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:01.718215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb258-22f5-43c0-9afc-8e0067d2e284 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:01.719438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 670/1344] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:01.724597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa5b50-acaf-4205-a7ef-3280cabc41cb None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:01.725049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa5b50-acaf-4205-a7ef-3280cabc41cb None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:01.725160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa5b50-acaf-4205-a7ef-3280cabc41cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:01.753081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-39aa5b50-acaf-4205-a7ef-3280cabc41cb None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:01.754244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-39aa5b50-acaf-4205-a7ef-3280cabc41cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:01.828750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 675/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:01.865799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eb258-22f5-43c0-9afc-8e0067d2e284 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:01.867495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-427eb258-22f5-43c0-9afc-8e0067d2e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:01.880082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eb258-22f5-43c0-9afc-8e0067d2e284 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:01.883564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34548c56-c923-401e-aaaf-17d75844eb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:01.884192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548c56-c923-401e-aaaf-17d75844eb33 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:01.884473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548c56-c923-401e-aaaf-17d75844eb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:01.884749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548c56-c923-401e-aaaf-17d75844eb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:01.893448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34548c56-c923-401e-aaaf-17d75844eb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:01.894885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34548c56-c923-401e-aaaf-17d75844eb33 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:01.904026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 671/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:06.460525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151153-27fd-48da-bda2-fb993a7b1e8a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:06.461016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151153-27fd-48da-bda2-fb993a7b1e8a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:06.461130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151153-27fd-48da-bda2-fb993a7b1e8a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:06.462494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 676/1347] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:06.467682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341f6e2-f77f-4668-ac77-ea919d2a27aa None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:06.468132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341f6e2-f77f-4668-ac77-ea919d2a27aa None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:06.468227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341f6e2-f77f-4668-ac77-ea919d2a27aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:06.485725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b341f6e2-f77f-4668-ac77-ea919d2a27aa None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:06.486904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b341f6e2-f77f-4668-ac77-ea919d2a27aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:06.494522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 672/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:06.531635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151153-27fd-48da-bda2-fb993a7b1e8a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:06.542206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151153-27fd-48da-bda2-fb993a7b1e8a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:06.547705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab33415-c99c-49a3-aeda-347dba5e9735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:06.548339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33415-c99c-49a3-aeda-347dba5e9735 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:06.548625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33415-c99c-49a3-aeda-347dba5e9735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:06.548990 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33415-c99c-49a3-aeda-347dba5e9735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:06.558437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab33415-c99c-49a3-aeda-347dba5e9735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:06.559872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab33415-c99c-49a3-aeda-347dba5e9735 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:06.569795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 677/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:11.882808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4aa2-5ba5-4ebb-a181-5d8d0994f5b7 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:11.883304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4aa2-5ba5-4ebb-a181-5d8d0994f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:11.883413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4aa2-5ba5-4ebb-a181-5d8d0994f5b7 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:11.885270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 673/1350] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:11.889642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43d7c-b590-466b-bd84-8e10b2da6c40 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:11.890549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43d7c-b590-466b-bd84-8e10b2da6c40 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:11.891024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43d7c-b590-466b-bd84-8e10b2da6c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:11.973082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d2b43d7c-b590-466b-bd84-8e10b2da6c40 None None] MFA Rules not processed for user `aa6eb30499054f368f00f38c946d7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:11.975019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d2b43d7c-b590-466b-bd84-8e10b2da6c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:12.110883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 678/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:37:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:16.256073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c3cf-c270-4008-a209-3ae010780713 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:16.256624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c3cf-c270-4008-a209-3ae010780713 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:16.256624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c3cf-c270-4008-a209-3ae010780713 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:16.258213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 674/1352] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:16.263129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701261ae-4d2e-413f-b01d-8f7291ef7a57 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:16.263582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701261ae-4d2e-413f-b01d-8f7291ef7a57 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:16.263690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701261ae-4d2e-413f-b01d-8f7291ef7a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:16.282253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-701261ae-4d2e-413f-b01d-8f7291ef7a57 None None] MFA Rules not processed for user `aa6eb30499054f368f00f38c946d7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:16.284306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-701261ae-4d2e-413f-b01d-8f7291ef7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:16.294617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 679/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:37:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:17.840168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5dfc-42f6-47e6-969f-001b05e0323a None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:17.840718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5dfc-42f6-47e6-969f-001b05e0323a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:17.840718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5dfc-42f6-47e6-969f-001b05e0323a None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:17.842097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 675/1354] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:17.847049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cc3ce-7c4b-4221-aae0-e8d5f7b9373f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:17.847474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cc3ce-7c4b-4221-aae0-e8d5f7b9373f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:17.847722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cc3ce-7c4b-4221-aae0-e8d5f7b9373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:17.865433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8a5cc3ce-7c4b-4221-aae0-e8d5f7b9373f None None] MFA Rules not processed for user `aa6eb30499054f368f00f38c946d7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:17.866747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8a5cc3ce-7c4b-4221-aae0-e8d5f7b9373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:17.875197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 680/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:37:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:21.749214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ccdc-d8c3-46fe-8f71-c7c054764c1c None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:21.749945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ccdc-d8c3-46fe-8f71-c7c054764c1c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:21.749945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ccdc-d8c3-46fe-8f71-c7c054764c1c None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:21.751428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 676/1356] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:21.756469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c350c-8a85-4d65-963b-3e3b7a75505b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:21.756871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c350c-8a85-4d65-963b-3e3b7a75505b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:21.757045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c350c-8a85-4d65-963b-3e3b7a75505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:21.775341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-258c350c-8a85-4d65-963b-3e3b7a75505b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:21.776648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-258c350c-8a85-4d65-963b-3e3b7a75505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:21.789874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 681/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:21.833895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8707-33bd-4adc-9789-12afbdaa4dd0 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:21.834316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8707-33bd-4adc-9789-12afbdaa4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:21.834742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8707-33bd-4adc-9789-12afbdaa4dd0 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:21.836371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 677/1358] 10.222.0.58 () {54 vars in 961 bytes} [Thu May 12 11:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:21.842669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a337a91-ce0f-401d-825a-d91405865c6f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:21.843224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a337a91-ce0f-401d-825a-d91405865c6f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:21.843599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a337a91-ce0f-401d-825a-d91405865c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:21.895556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6a337a91-ce0f-401d-825a-d91405865c6f None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:21.896979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6a337a91-ce0f-401d-825a-d91405865c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:21.983594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 682/1359] 10.222.0.58 () {58 vars in 1058 bytes} [Thu May 12 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:21.992731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc8707-33bd-4adc-9789-12afbdaa4dd0 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:22.007889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc8707-33bd-4adc-9789-12afbdaa4dd0 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:22.013487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849f17a-1918-4e87-9ac6-e38f4b382fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:22.014158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f17a-1918-4e87-9ac6-e38f4b382fff service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:22.014440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f17a-1918-4e87-9ac6-e38f4b382fff service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:22.014714 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849f17a-1918-4e87-9ac6-e38f4b382fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:22.023263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849f17a-1918-4e87-9ac6-e38f4b382fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:22.024857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849f17a-1918-4e87-9ac6-e38f4b382fff service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:22.035730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 678/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:37:24.509554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7cd6-c4a8-4d8b-98a6-dd192a17550f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:24.510046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7cd6-c4a8-4d8b-98a6-dd192a17550f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:24.510222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7cd6-c4a8-4d8b-98a6-dd192a17550f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:24.511664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 683/1361] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:24.516729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f668-bf71-44fb-b239-9b60c68bba24 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:24.517130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f668-bf71-44fb-b239-9b60c68bba24 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:24.517282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f668-bf71-44fb-b239-9b60c68bba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:24.535326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8878f668-bf71-44fb-b239-9b60c68bba24 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:24.536509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8878f668-bf71-44fb-b239-9b60c68bba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:24.544316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 679/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:24.589619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b7cd6-c4a8-4d8b-98a6-dd192a17550f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:24.604932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b7cd6-c4a8-4d8b-98a6-dd192a17550f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:24.610622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc41d-872e-439a-a286-b2d97b326885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:24.611252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc41d-872e-439a-a286-b2d97b326885 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:24.611649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc41d-872e-439a-a286-b2d97b326885 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:24.612564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc41d-872e-439a-a286-b2d97b326885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:24.620989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc41d-872e-439a-a286-b2d97b326885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:24.622758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc41d-872e-439a-a286-b2d97b326885 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:24.634694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 684/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:27.191203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4b83e-b7e7-44f2-b4d9-239f0def2e55 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:27.191720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4b83e-b7e7-44f2-b4d9-239f0def2e55 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:27.191812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4b83e-b7e7-44f2-b4d9-239f0def2e55 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:27.193112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 680/1364] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:27.199000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11104-73ae-4432-91c7-bbd06d38ab5e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:27.199415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11104-73ae-4432-91c7-bbd06d38ab5e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:27.199582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11104-73ae-4432-91c7-bbd06d38ab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:27.222869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3eb11104-73ae-4432-91c7-bbd06d38ab5e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:27.224424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3eb11104-73ae-4432-91c7-bbd06d38ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:27.242643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 685/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:27.278899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ce0c5-656e-466c-a9e6-b263e54c18be None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:27.279130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ce0c5-656e-466c-a9e6-b263e54c18be None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:27.279479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ce0c5-656e-466c-a9e6-b263e54c18be None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:27.280833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 681/1366] 10.222.0.58 () {54 vars in 961 bytes} [Thu May 12 11:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 11:37:27.286822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bd133-e5e2-4399-bc6a-b2fbff84b695 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:27.287109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bd133-e5e2-4399-bc6a-b2fbff84b695 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:27.287388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bd133-e5e2-4399-bc6a-b2fbff84b695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:27.305883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e30bd133-e5e2-4399-bc6a-b2fbff84b695 None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:27.307052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e30bd133-e5e2-4399-bc6a-b2fbff84b695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:27.316669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 686/1367] 10.222.0.58 () {58 vars in 1058 bytes} [Thu May 12 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:27.324678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ce0c5-656e-466c-a9e6-b263e54c18be None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:27.338575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ce0c5-656e-466c-a9e6-b263e54c18be None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:27.343872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187379-1eb0-4208-8d2c-42208427ee3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:27.344510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187379-1eb0-4208-8d2c-42208427ee3d service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:27.344775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187379-1eb0-4208-8d2c-42208427ee3d service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:27.345050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187379-1eb0-4208-8d2c-42208427ee3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:27.353446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8187379-1eb0-4208-8d2c-42208427ee3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:27.355034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8187379-1eb0-4208-8d2c-42208427ee3d service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:27.364820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 682/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:29.683849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87408f0-1835-4417-8145-d3ad96b8fde3 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:29.684456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87408f0-1835-4417-8145-d3ad96b8fde3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:29.684456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87408f0-1835-4417-8145-d3ad96b8fde3 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:29.685818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 687/1369] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:29.692286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79876d-8a8c-48a0-b4f5-0bab53276628 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:29.692769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79876d-8a8c-48a0-b4f5-0bab53276628 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:29.693034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79876d-8a8c-48a0-b4f5-0bab53276628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:29.711387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-fc79876d-8a8c-48a0-b4f5-0bab53276628 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:29.712702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fc79876d-8a8c-48a0-b4f5-0bab53276628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:29.720805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 683/1370] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:29.763793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87408f0-1835-4417-8145-d3ad96b8fde3 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:29.779318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87408f0-1835-4417-8145-d3ad96b8fde3 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:29.785257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4e2d9-7e94-4c4c-9332-1ca2d1cc97c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:29.786240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4e2d9-7e94-4c4c-9332-1ca2d1cc97c9 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:29.786805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4e2d9-7e94-4c4c-9332-1ca2d1cc97c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:29.787192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4e2d9-7e94-4c4c-9332-1ca2d1cc97c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:29.798139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4e2d9-7e94-4c4c-9332-1ca2d1cc97c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:29.800398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4e2d9-7e94-4c4c-9332-1ca2d1cc97c9 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:29.812893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 688/1371] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:29.987112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b80f-28f7-4909-a824-e9dcddb407a9 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:29.987444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b80f-28f7-4909-a824-e9dcddb407a9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:29.987722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b80f-28f7-4909-a824-e9dcddb407a9 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:29.989578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 684/1372] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:29.995173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491edbf0-75f4-4ff2-b49c-157bf9ad9871 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:29.995458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491edbf0-75f4-4ff2-b49c-157bf9ad9871 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:29.995739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491edbf0-75f4-4ff2-b49c-157bf9ad9871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:30.015767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-491edbf0-75f4-4ff2-b49c-157bf9ad9871 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:30.016901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-491edbf0-75f4-4ff2-b49c-157bf9ad9871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:30.025676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 689/1373] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:30.340219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af8447-9a08-402e-adc6-d1253d9d7851 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:30.340488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af8447-9a08-402e-adc6-d1253d9d7851 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:30.340768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af8447-9a08-402e-adc6-d1253d9d7851 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:30.342328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 685/1374] 10.222.0.58 () {54 vars in 963 bytes} [Thu May 12 11:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:30.347736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6948fe6-9653-411c-8c76-093b362ff1fd None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:30.348148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6948fe6-9653-411c-8c76-093b362ff1fd None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:30.348560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6948fe6-9653-411c-8c76-093b362ff1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:30.403058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f6948fe6-9653-411c-8c76-093b362ff1fd None None] MFA Rules not processed for user `d990142782ed4f2f92e51c2a76693009`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:30.404955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f6948fe6-9653-411c-8c76-093b362ff1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:30.479646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 690/1375] 10.222.0.58 () {58 vars in 1060 bytes} [Thu May 12 11:37:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:37:30.488511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af8447-9a08-402e-adc6-d1253d9d7851 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:30.503114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af8447-9a08-402e-adc6-d1253d9d7851 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:30.506454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5d11c-967b-464b-806e-8c5a9881bba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:30.507085 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5d11c-967b-464b-806e-8c5a9881bba4 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:30.507362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5d11c-967b-464b-806e-8c5a9881bba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:30.507632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5d11c-967b-464b-806e-8c5a9881bba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:30.518191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5d11c-967b-464b-806e-8c5a9881bba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:30.519611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5d11c-967b-464b-806e-8c5a9881bba4 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:30.529516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 686/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:32.167088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30bade-ff8d-4331-8bbf-fae6b32e8457 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:32.167635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30bade-ff8d-4331-8bbf-fae6b32e8457 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:32.167635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30bade-ff8d-4331-8bbf-fae6b32e8457 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:32.169008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 691/1377] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:32.174990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f9d22-c7be-44da-ba89-9258d29c3cfc None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:32.175507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f9d22-c7be-44da-ba89-9258d29c3cfc None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:32.175625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f9d22-c7be-44da-ba89-9258d29c3cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:32.194052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e04f9d22-c7be-44da-ba89-9258d29c3cfc None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:32.195295 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e04f9d22-c7be-44da-ba89-9258d29c3cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:32.203356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 687/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:32.248131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30bade-ff8d-4331-8bbf-fae6b32e8457 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:32.264255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30bade-ff8d-4331-8bbf-fae6b32e8457 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:32.271311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61980-df14-405e-8188-810777bfd6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:32.271960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61980-df14-405e-8188-810777bfd6ae service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:32.272243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61980-df14-405e-8188-810777bfd6ae service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:32.272524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61980-df14-405e-8188-810777bfd6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:32.281143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61980-df14-405e-8188-810777bfd6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:32.282814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61980-df14-405e-8188-810777bfd6ae service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:32.297158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 692/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:34.553200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcfa9a-ba57-47dd-b83d-331e9603bee6 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:34.553792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcfa9a-ba57-47dd-b83d-331e9603bee6 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:34.553792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcfa9a-ba57-47dd-b83d-331e9603bee6 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:34.555150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 688/1380] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:34.560374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8933e5-b611-4855-a7cf-0e3d86dd76bf None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:34.560790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8933e5-b611-4855-a7cf-0e3d86dd76bf None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:34.560930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8933e5-b611-4855-a7cf-0e3d86dd76bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:34.578844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ac8933e5-b611-4855-a7cf-0e3d86dd76bf None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:34.580023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ac8933e5-b611-4855-a7cf-0e3d86dd76bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:34.588699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 693/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:34.632327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcfa9a-ba57-47dd-b83d-331e9603bee6 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:34.647506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcfa9a-ba57-47dd-b83d-331e9603bee6 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:34.652953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f0a24-ff0f-433c-ad09-d9d83dfc8cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:34.653589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0a24-ff0f-433c-ad09-d9d83dfc8cfb service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:34.653923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0a24-ff0f-433c-ad09-d9d83dfc8cfb service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:34.654309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0a24-ff0f-433c-ad09-d9d83dfc8cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:34.663832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f0a24-ff0f-433c-ad09-d9d83dfc8cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:34.665555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f0a24-ff0f-433c-ad09-d9d83dfc8cfb service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:34.675879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 689/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:36.897273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91705-cba8-49fc-bba9-e5f2ca923557 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:36.898158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91705-cba8-49fc-bba9-e5f2ca923557 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:36.898434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91705-cba8-49fc-bba9-e5f2ca923557 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:36.899799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 694/1383] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:36.905121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6167f17-2345-4fb1-b98e-56f561498f71 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:36.905530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6167f17-2345-4fb1-b98e-56f561498f71 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:36.905670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6167f17-2345-4fb1-b98e-56f561498f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:36.923629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f6167f17-2345-4fb1-b98e-56f561498f71 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:36.924955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f6167f17-2345-4fb1-b98e-56f561498f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:36.932818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 690/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:36.977046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91705-cba8-49fc-bba9-e5f2ca923557 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:36.993016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91705-cba8-49fc-bba9-e5f2ca923557 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:36.998831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222b466-60f6-47d8-b785-c59659a2948b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:36.999494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222b466-60f6-47d8-b785-c59659a2948b service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:36.999772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222b466-60f6-47d8-b785-c59659a2948b service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:37.000045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222b466-60f6-47d8-b785-c59659a2948b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:37.009504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222b466-60f6-47d8-b785-c59659a2948b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:37.011120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222b466-60f6-47d8-b785-c59659a2948b service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:37.021159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 695/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:39.284046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808ec8-ab9d-46c6-9f58-8327e5d678cb None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:39.284750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808ec8-ab9d-46c6-9f58-8327e5d678cb None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:39.284750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808ec8-ab9d-46c6-9f58-8327e5d678cb None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:39.286060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 691/1386] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:39.291474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e6a2-3539-488d-8758-7f466146068a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:39.292043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e6a2-3539-488d-8758-7f466146068a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:39.292043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e6a2-3539-488d-8758-7f466146068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:39.310176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ad81e6a2-3539-488d-8758-7f466146068a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:39.311432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ad81e6a2-3539-488d-8758-7f466146068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:39.320297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 696/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:39.367958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808ec8-ab9d-46c6-9f58-8327e5d678cb None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:39.383638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808ec8-ab9d-46c6-9f58-8327e5d678cb None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:39.389103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2d0bb-360c-4e82-b51d-7e4268925f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:39.389764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2d0bb-360c-4e82-b51d-7e4268925f68 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:39.390054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2d0bb-360c-4e82-b51d-7e4268925f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:39.390334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2d0bb-360c-4e82-b51d-7e4268925f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:39.398695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2d0bb-360c-4e82-b51d-7e4268925f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:39.400286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2d0bb-360c-4e82-b51d-7e4268925f68 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:39.410248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 692/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:41.736492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd53484-0f6a-462e-af15-a0cc46397a78 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:41.737623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd53484-0f6a-462e-af15-a0cc46397a78 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:41.737770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd53484-0f6a-462e-af15-a0cc46397a78 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:41.739191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 697/1389] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:41.745942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4320bb-a82b-4be2-8870-ac9150b9325e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:41.746431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4320bb-a82b-4be2-8870-ac9150b9325e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:41.746675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4320bb-a82b-4be2-8870-ac9150b9325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:41.765576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-cc4320bb-a82b-4be2-8870-ac9150b9325e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:41.766774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-cc4320bb-a82b-4be2-8870-ac9150b9325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:41.775124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 693/1390] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:41.831804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd53484-0f6a-462e-af15-a0cc46397a78 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:41.850207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd53484-0f6a-462e-af15-a0cc46397a78 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:41.857337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b4b96-9a8a-4215-86be-5351defb144e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:41.858153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4b96-9a8a-4215-86be-5351defb144e service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:41.858695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4b96-9a8a-4215-86be-5351defb144e service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:41.859060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4b96-9a8a-4215-86be-5351defb144e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:41.870788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4b96-9a8a-4215-86be-5351defb144e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:41.872833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4b96-9a8a-4215-86be-5351defb144e service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:41.884387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 698/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:44.255202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aba71-6270-460d-81a7-0460b3ae5d3a None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:44.255861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aba71-6270-460d-81a7-0460b3ae5d3a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:44.255861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246aba71-6270-460d-81a7-0460b3ae5d3a None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:44.257208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 694/1392] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:44.262932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cae2-5f55-4398-a1ce-bdebadb32c98 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:44.263376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cae2-5f55-4398-a1ce-bdebadb32c98 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:44.263492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cae2-5f55-4398-a1ce-bdebadb32c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:44.280872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-9f61cae2-5f55-4398-a1ce-bdebadb32c98 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:44.282151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9f61cae2-5f55-4398-a1ce-bdebadb32c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:44.289899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 699/1393] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:44.334356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aba71-6270-460d-81a7-0460b3ae5d3a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:44.348457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246aba71-6270-460d-81a7-0460b3ae5d3a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:44.353868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af2b2-d832-4b95-982f-fa11b7fcb273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:44.354495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af2b2-d832-4b95-982f-fa11b7fcb273 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:44.354781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af2b2-d832-4b95-982f-fa11b7fcb273 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:44.355058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af2b2-d832-4b95-982f-fa11b7fcb273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:44.363540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af2b2-d832-4b95-982f-fa11b7fcb273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:44.365108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af2b2-d832-4b95-982f-fa11b7fcb273 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:44.374395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 695/1394] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:46.167374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151f306-70dc-403f-8f70-bc1756070a99 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.167928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151f306-70dc-403f-8f70-bc1756070a99 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.167928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151f306-70dc-403f-8f70-bc1756070a99 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.169210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 700/1395] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:46.175259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620d12c-e77f-41fb-b113-f51c9805d9eb None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.175686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620d12c-e77f-41fb-b113-f51c9805d9eb None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.175819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620d12c-e77f-41fb-b113-f51c9805d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.192961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7620d12c-e77f-41fb-b113-f51c9805d9eb None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:46.194451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7620d12c-e77f-41fb-b113-f51c9805d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:46.202972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 696/1396] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:46.259250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac879-4ad3-4051-8d52-7fad5d0147f7 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.259534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac879-4ad3-4051-8d52-7fad5d0147f7 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.259811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac879-4ad3-4051-8d52-7fad5d0147f7 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.261189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 701/1397] 10.222.0.58 () {54 vars in 962 bytes} [Thu May 12 11:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:46.266314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c288bc-48fb-480b-af1a-88a378f5b92d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.266602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c288bc-48fb-480b-af1a-88a378f5b92d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.266880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c288bc-48fb-480b-af1a-88a378f5b92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.315299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-81c288bc-48fb-480b-af1a-88a378f5b92d None None] MFA Rules not processed for user `a7291e3af37548efafd5e4654569677b`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:46.316487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-81c288bc-48fb-480b-af1a-88a378f5b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:46.373475 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 697/1398] 10.222.0.58 () {58 vars in 1059 bytes} [Thu May 12 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:46.381443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ac879-4ad3-4051-8d52-7fad5d0147f7 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:46.391800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ac879-4ad3-4051-8d52-7fad5d0147f7 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:46.395876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26557bb-9770-495c-8876-20848db40902 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7291e3af37548efafd5e4654569677b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:46.396495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26557bb-9770-495c-8876-20848db40902 service glance] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.396771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26557bb-9770-495c-8876-20848db40902 service glance] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.397039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26557bb-9770-495c-8876-20848db40902 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.406218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26557bb-9770-495c-8876-20848db40902 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:46.407749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26557bb-9770-495c-8876-20848db40902 service glance] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:46.416946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 702/1399] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:46.663978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d166ff-62f2-4b19-81bf-6571bf82f469 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.664272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d166ff-62f2-4b19-81bf-6571bf82f469 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.664551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d166ff-62f2-4b19-81bf-6571bf82f469 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.666106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 698/1400] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:46.677399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5595302-d084-4673-9cd4-2feec1a677a6 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.677737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5595302-d084-4673-9cd4-2feec1a677a6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.678061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5595302-d084-4673-9cd4-2feec1a677a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.696855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a5595302-d084-4673-9cd4-2feec1a677a6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:46.698092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a5595302-d084-4673-9cd4-2feec1a677a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:46.705904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 703/1401] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:46.749529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d166ff-62f2-4b19-81bf-6571bf82f469 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:46.764223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d166ff-62f2-4b19-81bf-6571bf82f469 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:46.769624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8ec5a-3694-487f-8e31-d98ff335013a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:46.770290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ec5a-3694-487f-8e31-d98ff335013a service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.770569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ec5a-3694-487f-8e31-d98ff335013a service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.770839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ec5a-3694-487f-8e31-d98ff335013a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.779159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8ec5a-3694-487f-8e31-d98ff335013a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:46.780743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8ec5a-3694-487f-8e31-d98ff335013a service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:46.791539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 699/1402] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:37:46.835764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cea6b-83a1-42d4-886a-f89e287e410f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:46.836054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cea6b-83a1-42d4-886a-f89e287e410f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:46.836337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cea6b-83a1-42d4-886a-f89e287e410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:46.889453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-058cea6b-83a1-42d4-886a-f89e287e410f None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:46.890717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-058cea6b-83a1-42d4-886a-f89e287e410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:46.961823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 704/1403] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:47.007010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250640cb-e0a7-488d-8b84-54f893f1a7a8 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:47.007204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250640cb-e0a7-488d-8b84-54f893f1a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:47.007480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250640cb-e0a7-488d-8b84-54f893f1a7a8 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:47.008912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 700/1404] 10.222.0.58 () {54 vars in 942 bytes} [Thu May 12 11:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:47.016178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce66c-7f5c-499a-9ec9-58f585893775 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:47.016471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce66c-7f5c-499a-9ec9-58f585893775 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:47.016750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce66c-7f5c-499a-9ec9-58f585893775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:47.065450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d95ce66c-7f5c-499a-9ec9-58f585893775 None None] MFA Rules not processed for user `6754ef93d9344beeae2a5f2812746025`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:47.066685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d95ce66c-7f5c-499a-9ec9-58f585893775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:47.136409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 705/1405] 10.222.0.58 () {58 vars in 1039 bytes} [Thu May 12 11:37:47 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:47.145949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250640cb-e0a7-488d-8b84-54f893f1a7a8 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:47.159685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250640cb-e0a7-488d-8b84-54f893f1a7a8 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:47.164724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02ed82-1bd7-4e42-8b42-d73f43e1ace3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:47.165351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ed82-1bd7-4e42-8b42-d73f43e1ace3 service swift] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:47.165631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ed82-1bd7-4e42-8b42-d73f43e1ace3 service swift] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:47.165938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ed82-1bd7-4e42-8b42-d73f43e1ace3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:47.173974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02ed82-1bd7-4e42-8b42-d73f43e1ace3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:47.175600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02ed82-1bd7-4e42-8b42-d73f43e1ace3 service swift] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:47.183609 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 701/1406] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:37:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:37:49.064381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1df85-47c5-4ebf-91a0-8374d0114174 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:49.065521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1df85-47c5-4ebf-91a0-8374d0114174 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:49.065521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1df85-47c5-4ebf-91a0-8374d0114174 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:49.067099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 706/1407] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:37:49.072771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414101-b17f-4832-88d5-eb803f75f013 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:49.073227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414101-b17f-4832-88d5-eb803f75f013 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:49.073328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414101-b17f-4832-88d5-eb803f75f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:49.092457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c4414101-b17f-4832-88d5-eb803f75f013 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:37:49.093774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c4414101-b17f-4832-88d5-eb803f75f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:37:49.101954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 702/1408] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:37:49.146524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1df85-47c5-4ebf-91a0-8374d0114174 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:37:49.165135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1df85-47c5-4ebf-91a0-8374d0114174 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:37:49.171341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526b50d-e0d0-4f83-9b60-9acd768fddb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:37:49.172075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b50d-e0d0-4f83-9b60-9acd768fddb1 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:37:49.172418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b50d-e0d0-4f83-9b60-9acd768fddb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:37:49.172764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b50d-e0d0-4f83-9b60-9acd768fddb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:37:49.181259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526b50d-e0d0-4f83-9b60-9acd768fddb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:37:49.182903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526b50d-e0d0-4f83-9b60-9acd768fddb1 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:37:49.193882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 707/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:10.586270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3160a9-ec07-4bca-836a-cab516c10fca None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:10.586901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3160a9-ec07-4bca-836a-cab516c10fca None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:10.586901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3160a9-ec07-4bca-836a-cab516c10fca None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:10.588184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 703/1410] 10.222.0.58 () {54 vars in 918 bytes} [Thu May 12 11:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:10.593241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f13dc-d8a2-4ea1-ad93-05b163f5a285 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:10.593670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f13dc-d8a2-4ea1-ad93-05b163f5a285 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:10.593808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f13dc-d8a2-4ea1-ad93-05b163f5a285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:10.611467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5c2f13dc-d8a2-4ea1-ad93-05b163f5a285 None None] MFA Rules not processed for user `aa6eb30499054f368f00f38c946d7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:10.613233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5c2f13dc-d8a2-4ea1-ad93-05b163f5a285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:10.621687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 708/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Thu May 12 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:10.636466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a817a-35e9-40d0-87d7-7a54838307a8 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:10.636751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a817a-35e9-40d0-87d7-7a54838307a8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:10.637026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a817a-35e9-40d0-87d7-7a54838307a8 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:10.638384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 704/1412] 10.222.0.58 () {54 vars in 918 bytes} [Thu May 12 11:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:10.642835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d342-c5fa-4e5a-b538-90fed8270508 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:10.643116 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d342-c5fa-4e5a-b538-90fed8270508 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:10.643386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d342-c5fa-4e5a-b538-90fed8270508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:10.660606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-10f4d342-c5fa-4e5a-b538-90fed8270508 None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:10.661802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-10f4d342-c5fa-4e5a-b538-90fed8270508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:10.670593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 709/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Thu May 12 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:13.357679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c7d93-ba8f-4991-99ef-7a3f8170be3b None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:13.358247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c7d93-ba8f-4991-99ef-7a3f8170be3b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:13.358247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c7d93-ba8f-4991-99ef-7a3f8170be3b None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:13.359600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:13.365566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206a3c-14a7-43dc-a808-609839619398 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:13.366090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206a3c-14a7-43dc-a808-609839619398 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:13.366199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58206a3c-14a7-43dc-a808-609839619398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:13.385588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-58206a3c-14a7-43dc-a808-609839619398 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:13.386837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58206a3c-14a7-43dc-a808-609839619398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:13.395348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:13.436047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c7d93-ba8f-4991-99ef-7a3f8170be3b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:13.450564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c7d93-ba8f-4991-99ef-7a3f8170be3b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:13.456297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc444bb-a271-4920-9c5f-dd1876e2308f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:13.456921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc444bb-a271-4920-9c5f-dd1876e2308f service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:13.457202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc444bb-a271-4920-9c5f-dd1876e2308f service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:13.457474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc444bb-a271-4920-9c5f-dd1876e2308f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:13.465488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc444bb-a271-4920-9c5f-dd1876e2308f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:13.467095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc444bb-a271-4920-9c5f-dd1876e2308f service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:13.476833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 706/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:14.451006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4397d2-aa30-4b4e-9bbe-ca7292f2d85a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:14.451572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4397d2-aa30-4b4e-9bbe-ca7292f2d85a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:14.451572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4397d2-aa30-4b4e-9bbe-ca7292f2d85a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:14.452934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:14.458094 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e18ac-3adc-4484-9451-f6f0f31afbd6 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:14.458477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e18ac-3adc-4484-9451-f6f0f31afbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:14.458640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e18ac-3adc-4484-9451-f6f0f31afbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:14.475958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9d2e18ac-3adc-4484-9451-f6f0f31afbd6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:14.477133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9d2e18ac-3adc-4484-9451-f6f0f31afbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:14.484762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:14.644640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4397d2-aa30-4b4e-9bbe-ca7292f2d85a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:14.658355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4397d2-aa30-4b4e-9bbe-ca7292f2d85a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:14.664029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f9d88-5fc9-48c6-91ec-0843341f629b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:14.664644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f9d88-5fc9-48c6-91ec-0843341f629b service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:14.664922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f9d88-5fc9-48c6-91ec-0843341f629b service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:14.665192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f9d88-5fc9-48c6-91ec-0843341f629b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:14.672882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f9d88-5fc9-48c6-91ec-0843341f629b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:14.675070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f9d88-5fc9-48c6-91ec-0843341f629b service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:14.684027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 712/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:15.617847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb695543-4c05-4c65-9e3a-ca2d61e9ada1 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:15.618413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb695543-4c05-4c65-9e3a-ca2d61e9ada1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:15.618413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb695543-4c05-4c65-9e3a-ca2d61e9ada1 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:15.619836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:15.624637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280e565-29df-404b-97ad-7907526c3fd8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:15.625021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280e565-29df-404b-97ad-7907526c3fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:15.625187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280e565-29df-404b-97ad-7907526c3fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:15.643027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c280e565-29df-404b-97ad-7907526c3fd8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:15.644707 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c280e565-29df-404b-97ad-7907526c3fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:15.652271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:38:15.798248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb695543-4c05-4c65-9e3a-ca2d61e9ada1 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:15.816013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb695543-4c05-4c65-9e3a-ca2d61e9ada1 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:15.822272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56ad88-9dab-4723-9398-b7605728afc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:15.822415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56ad88-9dab-4723-9398-b7605728afc3 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:15.822635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56ad88-9dab-4723-9398-b7605728afc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:15.822912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56ad88-9dab-4723-9398-b7605728afc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:15.831373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56ad88-9dab-4723-9398-b7605728afc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:15.832959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56ad88-9dab-4723-9398-b7605728afc3 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:15.844501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 709/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:16.775327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a8aa-07be-450d-a610-e34f3893c18a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:16.775915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a8aa-07be-450d-a610-e34f3893c18a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:16.775915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a8aa-07be-450d-a610-e34f3893c18a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:16.777158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:16.782102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b24eea-fbb6-4ac1-80b7-150bb99df70b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:16.782507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b24eea-fbb6-4ac1-80b7-150bb99df70b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:16.782654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b24eea-fbb6-4ac1-80b7-150bb99df70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:16.802067 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-75b24eea-fbb6-4ac1-80b7-150bb99df70b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:16.803254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-75b24eea-fbb6-4ac1-80b7-150bb99df70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:16.810928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:16.959784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a8aa-07be-450d-a610-e34f3893c18a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:16.974246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a8aa-07be-450d-a610-e34f3893c18a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:16.979546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cfeb2-2c63-444c-bb4d-9d2b4deb97bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:16.980165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cfeb2-2c63-444c-bb4d-9d2b4deb97bb service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:16.980445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cfeb2-2c63-444c-bb4d-9d2b4deb97bb service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:16.980720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cfeb2-2c63-444c-bb4d-9d2b4deb97bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:16.989187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cfeb2-2c63-444c-bb4d-9d2b4deb97bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:16.990797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cfeb2-2c63-444c-bb4d-9d2b4deb97bb service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:16.999840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 715/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:17.916441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558864-59dc-4c1a-81c2-90ef75ffb6ae None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:17.916991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558864-59dc-4c1a-81c2-90ef75ffb6ae None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:17.916991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558864-59dc-4c1a-81c2-90ef75ffb6ae None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:17.918410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:17.923220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedeb8-689e-4c2e-85b9-e19d4cffa8b4 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:17.923665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedeb8-689e-4c2e-85b9-e19d4cffa8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:17.923784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedeb8-689e-4c2e-85b9-e19d4cffa8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:17.943490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3cfedeb8-689e-4c2e-85b9-e19d4cffa8b4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:17.944718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3cfedeb8-689e-4c2e-85b9-e19d4cffa8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:17.952740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:18.100730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90558864-59dc-4c1a-81c2-90ef75ffb6ae None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:18.115199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90558864-59dc-4c1a-81c2-90ef75ffb6ae None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:18.120593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c386c-b871-4470-9b6f-b8dfe5336fd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:18.121218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c386c-b871-4470-9b6f-b8dfe5336fd9 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:18.121502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c386c-b871-4470-9b6f-b8dfe5336fd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:18.121808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c386c-b871-4470-9b6f-b8dfe5336fd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:18.130442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c386c-b871-4470-9b6f-b8dfe5336fd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:18.132029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c386c-b871-4470-9b6f-b8dfe5336fd9 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:18.141181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 712/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:38:19.002120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b768-a5f9-4cb9-a312-1fba081e3d21 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:19.002666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b768-a5f9-4cb9-a312-1fba081e3d21 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:19.002666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b768-a5f9-4cb9-a312-1fba081e3d21 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:19.004666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:19.009595 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4872a-6bff-478e-8951-e32f3948437d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:19.010050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4872a-6bff-478e-8951-e32f3948437d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:19.010173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4872a-6bff-478e-8951-e32f3948437d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:19.027489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-2fc4872a-6bff-478e-8951-e32f3948437d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:19.028682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2fc4872a-6bff-478e-8951-e32f3948437d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:19.037123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:19.186323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b768-a5f9-4cb9-a312-1fba081e3d21 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:19.201286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b768-a5f9-4cb9-a312-1fba081e3d21 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:19.206982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dcff0-74f2-488a-be4e-6e97672dd3d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:19.207633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcff0-74f2-488a-be4e-6e97672dd3d0 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:19.207917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcff0-74f2-488a-be4e-6e97672dd3d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:19.208200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcff0-74f2-488a-be4e-6e97672dd3d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:19.217330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dcff0-74f2-488a-be4e-6e97672dd3d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:19.218981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dcff0-74f2-488a-be4e-6e97672dd3d0 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:19.229768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 718/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:20.093259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e658-e003-453e-9da7-9fd444e41dda None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:20.093826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e658-e003-453e-9da7-9fd444e41dda None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:20.093826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e658-e003-453e-9da7-9fd444e41dda None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:20.095131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:20.100429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11190-95de-4d44-b503-1922d38c41e6 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:20.100842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11190-95de-4d44-b503-1922d38c41e6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:20.101022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11190-95de-4d44-b503-1922d38c41e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:20.119079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-baa11190-95de-4d44-b503-1922d38c41e6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:20.120264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-baa11190-95de-4d44-b503-1922d38c41e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:20.128007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:20.276370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5e658-e003-453e-9da7-9fd444e41dda None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:20.291014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5e658-e003-453e-9da7-9fd444e41dda None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:20.296293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0f14-d06b-46b7-ab47-2055306ae383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:20.296909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0f14-d06b-46b7-ab47-2055306ae383 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:20.297189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0f14-d06b-46b7-ab47-2055306ae383 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:20.297462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0f14-d06b-46b7-ab47-2055306ae383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:20.305322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0f14-d06b-46b7-ab47-2055306ae383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:20.306946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0f14-d06b-46b7-ab47-2055306ae383 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:20.316026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 715/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:21.179942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5da45-1e0d-4b86-a3bc-278d2e58c1ff None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:21.180514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5da45-1e0d-4b86-a3bc-278d2e58c1ff None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:21.180514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5da45-1e0d-4b86-a3bc-278d2e58c1ff None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:21.181890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:21.186743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9510b-3583-4f27-babe-4cecfd3842e4 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:21.187158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9510b-3583-4f27-babe-4cecfd3842e4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:21.187330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9510b-3583-4f27-babe-4cecfd3842e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:21.205732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-06e9510b-3583-4f27-babe-4cecfd3842e4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:21.206928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-06e9510b-3583-4f27-babe-4cecfd3842e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:21.214647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:21.362211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5da45-1e0d-4b86-a3bc-278d2e58c1ff None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:21.376787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5da45-1e0d-4b86-a3bc-278d2e58c1ff None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:21.382228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b85706-0ed8-4000-9e05-e85d50dc10b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:21.382871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85706-0ed8-4000-9e05-e85d50dc10b0 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:21.383153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85706-0ed8-4000-9e05-e85d50dc10b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:21.383429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85706-0ed8-4000-9e05-e85d50dc10b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:21.391361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b85706-0ed8-4000-9e05-e85d50dc10b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:21.392943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b85706-0ed8-4000-9e05-e85d50dc10b0 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:21.405071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 721/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:22.272636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025385-08ff-4dd0-8682-b52ac3730e3d None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:22.273208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025385-08ff-4dd0-8682-b52ac3730e3d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:22.273208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025385-08ff-4dd0-8682-b52ac3730e3d None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:22.274613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:22.279528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ecb9-997b-426f-b5b1-1175e7ecc898 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:22.279969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ecb9-997b-426f-b5b1-1175e7ecc898 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:22.280077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ecb9-997b-426f-b5b1-1175e7ecc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:22.299065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b6b9ecb9-997b-426f-b5b1-1175e7ecc898 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:22.300865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b6b9ecb9-997b-426f-b5b1-1175e7ecc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:22.308571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:22.455826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025385-08ff-4dd0-8682-b52ac3730e3d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:22.472929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025385-08ff-4dd0-8682-b52ac3730e3d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:22.481729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0554-7939-4485-b289-a24b0e62dd54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:22.482384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0554-7939-4485-b289-a24b0e62dd54 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:22.482670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0554-7939-4485-b289-a24b0e62dd54 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:22.482950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0554-7939-4485-b289-a24b0e62dd54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:22.491363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f0554-7939-4485-b289-a24b0e62dd54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:22.492939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f0554-7939-4485-b289-a24b0e62dd54 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:22.502304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 718/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:24.614810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630a3cd-7562-456e-b91c-e7897a21152d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:24.615344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630a3cd-7562-456e-b91c-e7897a21152d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:24.615344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630a3cd-7562-456e-b91c-e7897a21152d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:24.616730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:24.622222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2ea7-db48-4933-8b10-51e9a84d4344 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:24.622649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2ea7-db48-4933-8b10-51e9a84d4344 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:24.622785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2ea7-db48-4933-8b10-51e9a84d4344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:24.640075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-10dd2ea7-db48-4933-8b10-51e9a84d4344 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:24.641372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-10dd2ea7-db48-4933-8b10-51e9a84d4344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:24.649689 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:24.686986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630a3cd-7562-456e-b91c-e7897a21152d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:24.698404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630a3cd-7562-456e-b91c-e7897a21152d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:24.701837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fb391-a244-466c-abfd-782f39671798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:24.702458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb391-a244-466c-abfd-782f39671798 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:24.702740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb391-a244-466c-abfd-782f39671798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:24.703014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb391-a244-466c-abfd-782f39671798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:24.712564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fb391-a244-466c-abfd-782f39671798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:24.714021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fb391-a244-466c-abfd-782f39671798 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:24.724571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 724/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:27.134292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf236-4df9-4165-b061-959bbf6db8a2 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:27.134750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf236-4df9-4165-b061-959bbf6db8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:27.134845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf236-4df9-4165-b061-959bbf6db8a2 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:27.136222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:27.141360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb0e34-895f-470a-94d7-06432d0db4ea None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:27.141834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb0e34-895f-470a-94d7-06432d0db4ea None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:27.141934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb0e34-895f-470a-94d7-06432d0db4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:27.159434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-83eb0e34-895f-470a-94d7-06432d0db4ea None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:27.160659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-83eb0e34-895f-470a-94d7-06432d0db4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:27.168366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:27.209050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddf236-4df9-4165-b061-959bbf6db8a2 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:27.219444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddf236-4df9-4165-b061-959bbf6db8a2 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:27.222904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424f647-e999-44be-9faa-20321d5dab89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:27.223530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424f647-e999-44be-9faa-20321d5dab89 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:27.223813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424f647-e999-44be-9faa-20321d5dab89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:27.224089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424f647-e999-44be-9faa-20321d5dab89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:27.233412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424f647-e999-44be-9faa-20321d5dab89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:27.234870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424f647-e999-44be-9faa-20321d5dab89 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:27.244559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 721/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:29.765962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c6a9-34b6-411b-a3aa-069176025d01 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:29.766481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c6a9-34b6-411b-a3aa-069176025d01 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:29.766481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c6a9-34b6-411b-a3aa-069176025d01 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:29.767823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:29.773769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43032b-591b-4eac-b9b7-0a67c62ddc39 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:29.774198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43032b-591b-4eac-b9b7-0a67c62ddc39 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:29.774334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43032b-591b-4eac-b9b7-0a67c62ddc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:29.791513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-fe43032b-591b-4eac-b9b7-0a67c62ddc39 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:29.792707 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fe43032b-591b-4eac-b9b7-0a67c62ddc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:29.800415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:29.838490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c6a9-34b6-411b-a3aa-069176025d01 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:29.849208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c6a9-34b6-411b-a3aa-069176025d01 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:29.852847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001a3f8-9047-4737-8d03-402ef4d6d64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:29.853475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001a3f8-9047-4737-8d03-402ef4d6d64b service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:29.853796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001a3f8-9047-4737-8d03-402ef4d6d64b service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:29.854100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001a3f8-9047-4737-8d03-402ef4d6d64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:29.863412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001a3f8-9047-4737-8d03-402ef4d6d64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:29.864842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001a3f8-9047-4737-8d03-402ef4d6d64b service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:29.874069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 727/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:32.214702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b783a1-55c2-4c87-89e9-2068cf2ced08 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:32.215289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b783a1-55c2-4c87-89e9-2068cf2ced08 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:32.215289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b783a1-55c2-4c87-89e9-2068cf2ced08 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:32.216552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:32.221823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91d141-9c89-4cbb-ba3f-cd2c7ff46360 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:32.222261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91d141-9c89-4cbb-ba3f-cd2c7ff46360 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:32.222434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91d141-9c89-4cbb-ba3f-cd2c7ff46360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:32.240274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-eb91d141-9c89-4cbb-ba3f-cd2c7ff46360 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:32.241461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-eb91d141-9c89-4cbb-ba3f-cd2c7ff46360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:32.249243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:32.286483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b783a1-55c2-4c87-89e9-2068cf2ced08 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:32.296848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b783a1-55c2-4c87-89e9-2068cf2ced08 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:32.301122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3beb2-c902-4e8b-a978-967325976858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:32.301778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3beb2-c902-4e8b-a978-967325976858 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:32.302064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3beb2-c902-4e8b-a978-967325976858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:32.302337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3beb2-c902-4e8b-a978-967325976858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:32.310997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3beb2-c902-4e8b-a978-967325976858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:32.312417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3beb2-c902-4e8b-a978-967325976858 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:32.322528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 724/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:34.611476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464844-bd34-4ec8-8d78-9ab36906dc6c None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:34.612020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464844-bd34-4ec8-8d78-9ab36906dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:34.612020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464844-bd34-4ec8-8d78-9ab36906dc6c None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:34.613411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:34.618693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac2f66-e8f2-4afc-b970-26af4bec9803 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:34.619123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac2f66-e8f2-4afc-b970-26af4bec9803 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:34.619257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac2f66-e8f2-4afc-b970-26af4bec9803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:34.636965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-21ac2f66-e8f2-4afc-b970-26af4bec9803 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:34.638176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-21ac2f66-e8f2-4afc-b970-26af4bec9803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:34.646340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:38:34.683113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464844-bd34-4ec8-8d78-9ab36906dc6c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:34.693542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464844-bd34-4ec8-8d78-9ab36906dc6c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:34.697248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e909-fd52-4265-a22c-b4d273177883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:34.697906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e909-fd52-4265-a22c-b4d273177883 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:34.698188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e909-fd52-4265-a22c-b4d273177883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:34.698459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e909-fd52-4265-a22c-b4d273177883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:34.707633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3e909-fd52-4265-a22c-b4d273177883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:34.709045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3e909-fd52-4265-a22c-b4d273177883 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:34.718569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 730/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:36.983887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50460-426e-4217-bc8b-45580b52d989 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:36.984451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50460-426e-4217-bc8b-45580b52d989 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:36.984451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50460-426e-4217-bc8b-45580b52d989 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:36.985795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:36.991210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a492-e541-4066-9384-ccd6654ddf4a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:36.991643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a492-e541-4066-9384-ccd6654ddf4a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:36.991761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a492-e541-4066-9384-ccd6654ddf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:37.009305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-58f1a492-e541-4066-9384-ccd6654ddf4a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:37.010505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58f1a492-e541-4066-9384-ccd6654ddf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:37.018044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:37.054560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50460-426e-4217-bc8b-45580b52d989 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:37.065042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50460-426e-4217-bc8b-45580b52d989 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:37.069110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cc2b0-b95f-41f1-a8b3-583ea91e886f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:37.069761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cc2b0-b95f-41f1-a8b3-583ea91e886f service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:37.070050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cc2b0-b95f-41f1-a8b3-583ea91e886f service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:37.070326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cc2b0-b95f-41f1-a8b3-583ea91e886f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:37.079402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cc2b0-b95f-41f1-a8b3-583ea91e886f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:37.080827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cc2b0-b95f-41f1-a8b3-583ea91e886f service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:37.090695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 727/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:39.362077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab694ce4-bb55-4d00-8936-cf48b990b5c3 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:39.362648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab694ce4-bb55-4d00-8936-cf48b990b5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:39.362648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab694ce4-bb55-4d00-8936-cf48b990b5c3 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:39.364070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:39.369384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40423c-b0ba-4042-8059-82b9591c927c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:39.369838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40423c-b0ba-4042-8059-82b9591c927c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:39.369982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40423c-b0ba-4042-8059-82b9591c927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:39.387702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-5c40423c-b0ba-4042-8059-82b9591c927c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:39.388885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5c40423c-b0ba-4042-8059-82b9591c927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:39.397210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:39.433044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab694ce4-bb55-4d00-8936-cf48b990b5c3 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:39.444142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab694ce4-bb55-4d00-8936-cf48b990b5c3 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:39.447968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea18b64-8265-4ad8-9a6c-d237064c1f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:39.448601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18b64-8265-4ad8-9a6c-d237064c1f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:39.448886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18b64-8265-4ad8-9a6c-d237064c1f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:39.449161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18b64-8265-4ad8-9a6c-d237064c1f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:39.458838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea18b64-8265-4ad8-9a6c-d237064c1f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:39.460272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea18b64-8265-4ad8-9a6c-d237064c1f86 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:39.469461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 733/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:41.722880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc899-5b4e-4961-8d79-cbd639ff0cd4 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:41.723463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc899-5b4e-4961-8d79-cbd639ff0cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:41.723463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc899-5b4e-4961-8d79-cbd639ff0cd4 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:41.724882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:41.730231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909f1e9-99b8-4857-9f68-cce05f49e9f1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:41.730659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909f1e9-99b8-4857-9f68-cce05f49e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:41.730796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909f1e9-99b8-4857-9f68-cce05f49e9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:41.748531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-9909f1e9-99b8-4857-9f68-cce05f49e9f1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:41.749757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9909f1e9-99b8-4857-9f68-cce05f49e9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:41.757730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:41.794113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc899-5b4e-4961-8d79-cbd639ff0cd4 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:41.805097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc899-5b4e-4961-8d79-cbd639ff0cd4 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:41.808582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a2da2-1fd7-4fb9-9224-c053790d9b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:41.809205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a2da2-1fd7-4fb9-9224-c053790d9b26 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:41.809519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a2da2-1fd7-4fb9-9224-c053790d9b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:41.809836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a2da2-1fd7-4fb9-9224-c053790d9b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:41.818587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a2da2-1fd7-4fb9-9224-c053790d9b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:41.820005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a2da2-1fd7-4fb9-9224-c053790d9b26 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:41.829610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 730/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:44.047178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e7d0-6752-49f5-b76d-7cdab02398cb None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:44.047735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e7d0-6752-49f5-b76d-7cdab02398cb None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:44.047735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e7d0-6752-49f5-b76d-7cdab02398cb None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:44.049133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:44.055185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafa20b-b09c-4e52-8bc2-392e43fc8356 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:44.055622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafa20b-b09c-4e52-8bc2-392e43fc8356 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:44.055727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafa20b-b09c-4e52-8bc2-392e43fc8356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:44.072973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-aeafa20b-b09c-4e52-8bc2-392e43fc8356 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:44.074178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-aeafa20b-b09c-4e52-8bc2-392e43fc8356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:44.081709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:44.117302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495e7d0-6752-49f5-b76d-7cdab02398cb None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:44.127715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495e7d0-6752-49f5-b76d-7cdab02398cb None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:44.131251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccfb0a-675a-4330-b392-d1cc452964fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:44.131889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccfb0a-675a-4330-b392-d1cc452964fb service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:44.132169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccfb0a-675a-4330-b392-d1cc452964fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:44.132442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccfb0a-675a-4330-b392-d1cc452964fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:44.141091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccfb0a-675a-4330-b392-d1cc452964fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:44.142560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccfb0a-675a-4330-b392-d1cc452964fb service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:44.152238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 736/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:38:46.342971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a9eea-145d-4783-a2ff-3bf019760bfe None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:46.343529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a9eea-145d-4783-a2ff-3bf019760bfe None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:46.343529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a9eea-145d-4783-a2ff-3bf019760bfe None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:46.344919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:38:46.350356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc537a6-ff3f-4fa4-8bb9-3b41b54d17ce None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:46.350798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc537a6-ff3f-4fa4-8bb9-3b41b54d17ce None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:46.350903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc537a6-ff3f-4fa4-8bb9-3b41b54d17ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:46.368637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6bc537a6-ff3f-4fa4-8bb9-3b41b54d17ce None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:38:46.369862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6bc537a6-ff3f-4fa4-8bb9-3b41b54d17ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:38:46.377498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:38:46.412864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a9eea-145d-4783-a2ff-3bf019760bfe None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:38:46.423324 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a9eea-145d-4783-a2ff-3bf019760bfe None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:38:46.427344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695e5e7-77a6-4e50-98fb-4dccab13c478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:38:46.427966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695e5e7-77a6-4e50-98fb-4dccab13c478 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:38:46.428250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695e5e7-77a6-4e50-98fb-4dccab13c478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:38:46.428523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695e5e7-77a6-4e50-98fb-4dccab13c478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:38:46.437188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695e5e7-77a6-4e50-98fb-4dccab13c478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:38:46.438642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695e5e7-77a6-4e50-98fb-4dccab13c478 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:38:46.448633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 733/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:39:19.500223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1adb2-9383-4015-9164-ecda96fa52b6 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:19.500819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1adb2-9383-4015-9164-ecda96fa52b6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:19.500819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1adb2-9383-4015-9164-ecda96fa52b6 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:19.502189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 738/1471] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:19.507989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a67b-d5a6-4d97-9383-7afcd5c9825d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:19.508423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a67b-d5a6-4d97-9383-7afcd5c9825d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:19.508562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a67b-d5a6-4d97-9383-7afcd5c9825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:19.525597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-df36a67b-d5a6-4d97-9383-7afcd5c9825d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:19.526824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-df36a67b-d5a6-4d97-9383-7afcd5c9825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:19.534450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 734/1472] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:39:19.580884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277af8e1-5df1-4711-ab74-e206a820baf6 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:19.581166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277af8e1-5df1-4711-ab74-e206a820baf6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:19.581435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277af8e1-5df1-4711-ab74-e206a820baf6 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:19.582826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 739/1473] 10.222.0.58 () {54 vars in 962 bytes} [Thu May 12 11:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:19.587606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229d9e-13cb-4d82-b169-49d8cc9fe0f1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:19.587889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229d9e-13cb-4d82-b169-49d8cc9fe0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:19.588162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229d9e-13cb-4d82-b169-49d8cc9fe0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:19.605367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-87229d9e-13cb-4d82-b169-49d8cc9fe0f1 None None] MFA Rules not processed for user `a7291e3af37548efafd5e4654569677b`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:19.606558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-87229d9e-13cb-4d82-b169-49d8cc9fe0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:19.612815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 735/1474] 10.222.0.58 () {58 vars in 1059 bytes} [Thu May 12 11:39:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:39:19.620380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277af8e1-5df1-4711-ab74-e206a820baf6 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:39:19.631108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277af8e1-5df1-4711-ab74-e206a820baf6 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:39:19.634508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda2064-faa1-4b97-b223-5a155ea2c27f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7291e3af37548efafd5e4654569677b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:39:19.635117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda2064-faa1-4b97-b223-5a155ea2c27f service glance] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:19.635392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda2064-faa1-4b97-b223-5a155ea2c27f service glance] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:19.635661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda2064-faa1-4b97-b223-5a155ea2c27f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:19.644169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda2064-faa1-4b97-b223-5a155ea2c27f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:39:19.645899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda2064-faa1-4b97-b223-5a155ea2c27f service glance] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:39:19.655150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 740/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:39:21.972409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9939f-9bbb-487d-af43-c2604eed84f8 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:21.972969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9939f-9bbb-487d-af43-c2604eed84f8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:21.972969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9939f-9bbb-487d-af43-c2604eed84f8 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:21.974381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 736/1476] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:21.979629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862fe78-7bc7-4758-8851-62257ef14cbf None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:21.980015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862fe78-7bc7-4758-8851-62257ef14cbf None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:21.980188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862fe78-7bc7-4758-8851-62257ef14cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:21.997895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6862fe78-7bc7-4758-8851-62257ef14cbf None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:21.999078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6862fe78-7bc7-4758-8851-62257ef14cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:22.007420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 741/1477] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:39:22.029789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9939f-9bbb-487d-af43-c2604eed84f8 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:39:22.042243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9939f-9bbb-487d-af43-c2604eed84f8 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:39:22.046560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcd8c3-fe47-4369-b51c-0a7b0d4a8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:39:22.047182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd8c3-fe47-4369-b51c-0a7b0d4a8e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:22.047458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd8c3-fe47-4369-b51c-0a7b0d4a8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:22.047729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd8c3-fe47-4369-b51c-0a7b0d4a8e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:22.048480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcd8c3-fe47-4369-b51c-0a7b0d4a8e43 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:39:22.050245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-e7dcd8c3-fe47-4369-b51c-0a7b0d4a8e43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:39:22.050245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:39:22.050245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:39:22.051386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcd8c3-fe47-4369-b51c-0a7b0d4a8e43 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:39:22.070944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 737/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 12 11:39:22 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:39:24.294463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc92b-1a18-4c30-a50d-fb29c91de480 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:24.295022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc92b-1a18-4c30-a50d-fb29c91de480 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:24.295022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc92b-1a18-4c30-a50d-fb29c91de480 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:24.296374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 742/1479] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:24.301619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c3ef-3ede-47f8-b9b0-33e55870777d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:24.302091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c3ef-3ede-47f8-b9b0-33e55870777d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:24.302228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c3ef-3ede-47f8-b9b0-33e55870777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:24.319895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6854c3ef-3ede-47f8-b9b0-33e55870777d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:24.321070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6854c3ef-3ede-47f8-b9b0-33e55870777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:24.328976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 738/1480] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:39:24.370246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc92b-1a18-4c30-a50d-fb29c91de480 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:39:24.384856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc92b-1a18-4c30-a50d-fb29c91de480 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:39:24.390184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359b88-be51-4df9-bcef-3c429d3a019a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:39:24.390806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359b88-be51-4df9-bcef-3c429d3a019a service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:24.391089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359b88-be51-4df9-bcef-3c429d3a019a service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:24.391371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359b88-be51-4df9-bcef-3c429d3a019a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:24.399785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359b88-be51-4df9-bcef-3c429d3a019a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:39:24.401360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359b88-be51-4df9-bcef-3c429d3a019a service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:39:24.410419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 743/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:39:26.793156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e584-1b79-42dd-91ca-da89266c31a3 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:26.793741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e584-1b79-42dd-91ca-da89266c31a3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:26.793741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e584-1b79-42dd-91ca-da89266c31a3 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:26.795111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 739/1482] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:26.800284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a941a4-b757-482a-b687-7eea65d1468d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:26.800670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a941a4-b757-482a-b687-7eea65d1468d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:26.800845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a941a4-b757-482a-b687-7eea65d1468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:26.818736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c1a941a4-b757-482a-b687-7eea65d1468d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:26.819951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c1a941a4-b757-482a-b687-7eea65d1468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:26.827886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 744/1483] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:39:26.863234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e584-1b79-42dd-91ca-da89266c31a3 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:39:26.874197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e584-1b79-42dd-91ca-da89266c31a3 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:39:26.877675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba8a82-04ee-4dac-a061-1e6f3ca11514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:39:26.878321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba8a82-04ee-4dac-a061-1e6f3ca11514 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:26.878607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba8a82-04ee-4dac-a061-1e6f3ca11514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:26.878881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba8a82-04ee-4dac-a061-1e6f3ca11514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:26.888123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba8a82-04ee-4dac-a061-1e6f3ca11514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:39:26.889549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba8a82-04ee-4dac-a061-1e6f3ca11514 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:39:26.898747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 740/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:39:29.150179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7e1d-c4af-4169-a2ab-b3bffd63a73d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:29.150732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7e1d-c4af-4169-a2ab-b3bffd63a73d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:29.150732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7e1d-c4af-4169-a2ab-b3bffd63a73d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:29.152088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 745/1485] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:29.157232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1ff97-cd06-4333-b752-e31f0b293ae2 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:29.157642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1ff97-cd06-4333-b752-e31f0b293ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:29.157839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1ff97-cd06-4333-b752-e31f0b293ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:29.176298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bdb1ff97-cd06-4333-b752-e31f0b293ae2 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:29.177736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bdb1ff97-cd06-4333-b752-e31f0b293ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:29.186279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 741/1486] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:39:29.230411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a7e1d-c4af-4169-a2ab-b3bffd63a73d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:39:29.241099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a7e1d-c4af-4169-a2ab-b3bffd63a73d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:39:29.244713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca909-56f2-47bf-8e93-3158d4cbb1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:39:29.245257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca909-56f2-47bf-8e93-3158d4cbb1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:29.245569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca909-56f2-47bf-8e93-3158d4cbb1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:29.245837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca909-56f2-47bf-8e93-3158d4cbb1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:29.255127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca909-56f2-47bf-8e93-3158d4cbb1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:39:29.256563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca909-56f2-47bf-8e93-3158d4cbb1a6 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:39:29.265922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 746/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:39:31.572853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc153a-0708-472c-bd5d-b33a134af68e None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:31.573368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc153a-0708-472c-bd5d-b33a134af68e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:31.573485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc153a-0708-472c-bd5d-b33a134af68e None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:31.575066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 742/1488] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:31.582446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f01d02-039c-46b7-bc92-1789854212be None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:31.583586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f01d02-039c-46b7-bc92-1789854212be None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:31.583586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f01d02-039c-46b7-bc92-1789854212be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:31.601394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-10f01d02-039c-46b7-bc92-1789854212be None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:31.602623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-10f01d02-039c-46b7-bc92-1789854212be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:31.610348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 747/1489] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:39:31.649482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc153a-0708-472c-bd5d-b33a134af68e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:39:31.659872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc153a-0708-472c-bd5d-b33a134af68e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:39:31.663938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda699-4485-4000-8c06-892935fa1827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:39:31.664558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda699-4485-4000-8c06-892935fa1827 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:31.664842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda699-4485-4000-8c06-892935fa1827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:31.665121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda699-4485-4000-8c06-892935fa1827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:31.673786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda699-4485-4000-8c06-892935fa1827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:39:31.675185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda699-4485-4000-8c06-892935fa1827 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:39:31.684535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 743/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:39:34.061464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4dd11-d68f-4114-990b-766388808672 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:34.062065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4dd11-d68f-4114-990b-766388808672 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:34.062065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4dd11-d68f-4114-990b-766388808672 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:34.063422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 748/1491] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 12 11:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:39:34.069095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8840f-999d-4990-8c08-011a1fc1d432 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:34.069483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8840f-999d-4990-8c08-011a1fc1d432 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:34.069679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8840f-999d-4990-8c08-011a1fc1d432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:34.087735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8bc8840f-999d-4990-8c08-011a1fc1d432 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:39:34.088921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8bc8840f-999d-4990-8c08-011a1fc1d432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:39:34.096655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 744/1492] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 12 11:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:39:34.134682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4dd11-d68f-4114-990b-766388808672 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:39:34.145280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4dd11-d68f-4114-990b-766388808672 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:39:34.149401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a5aee-5bca-456d-9461-8b24b4b11a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:39:34.150055 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5aee-5bca-456d-9461-8b24b4b11a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:39:34.150340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5aee-5bca-456d-9461-8b24b4b11a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:39:34.150617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5aee-5bca-456d-9461-8b24b4b11a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:39:34.159353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a5aee-5bca-456d-9461-8b24b4b11a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:39:34.160778 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a5aee-5bca-456d-9461-8b24b4b11a33 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:39:34.169869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 749/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:41:07.504244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bb947-205d-4404-9093-d8e338c7c4f6 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.504741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bb947-205d-4404-9093-d8e338c7c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.504844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bb947-205d-4404-9093-d8e338c7c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.522789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ff5bb947-205d-4404-9093-d8e338c7c4f6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:41:07.523999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ff5bb947-205d-4404-9093-d8e338c7c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:41:07.531712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 745/1494] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:41:07.540722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368ed30-e10f-4945-adc2-5eaa72560773 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.541208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368ed30-e10f-4945-adc2-5eaa72560773 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.541315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368ed30-e10f-4945-adc2-5eaa72560773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.559195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6368ed30-e10f-4945-adc2-5eaa72560773 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:41:07.560407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6368ed30-e10f-4945-adc2-5eaa72560773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:41:07.568307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 750/1495] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:41:07.573150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bb947-205d-4404-9093-d8e338c7c4f6 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:07.582841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bb947-205d-4404-9093-d8e338c7c4f6 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:07.587237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:07.587873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.588148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.588420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.589132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:41:07.589433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:07.590464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:07.590464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:41:07.590464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:41:07.591331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:07.602310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 746/1496] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:41:07.610127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368ed30-e10f-4945-adc2-5eaa72560773 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:07.619474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368ed30-e10f-4945-adc2-5eaa72560773 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:07.623960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:07.624597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.624882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.625162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.625887 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:07.627643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING py.warnings [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:07.627643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: warnings.warn(msg) May 12 11:41:07.627643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: May 12 11:41:07.628843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:07.664398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 751/1497] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:41:07 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:41:07.668798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:07.678511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb90e3-d9ef-4f83-af34-b2a649ed9379 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:07.731952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:07.732610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.732896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.733174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.733896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:07.734903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:07.734903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:41:07.734903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:41:07.736115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:07.755489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 747/1498] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:41:07 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:41:07.760074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:07.769942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746fb4b-6399-4ffb-b3dc-ccc6c594e17e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:07.774314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:07.774951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.775228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.775497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.776311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:07.777309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING py.warnings [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:07.777309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: warnings.warn(msg) May 12 11:41:07.777309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: May 12 11:41:07.778217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:07.791407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 752/1499] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:41:07.795168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:07.804791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cad3a0-0c51-4148-b23a-865ed7f8af11 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:07.809859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7d6fd-7673-490e-9ab9-647cd985a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:07.810500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7d6fd-7673-490e-9ab9-647cd985a3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.810785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7d6fd-7673-490e-9ab9-647cd985a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.811062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7d6fd-7673-490e-9ab9-647cd985a3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.811780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7d6fd-7673-490e-9ab9-647cd985a3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:07.812780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-c1c7d6fd-7673-490e-9ab9-647cd985a3cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:07.812780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:41:07.812780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:41:07.813661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7d6fd-7673-490e-9ab9-647cd985a3cb admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:07.826540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 748/1500] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:41:07.830439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:07.840063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82928-df14-4e95-a127-418fe1beca35 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:07.844465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1f7a-3a67-4465-91d0-edad5e3f35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:07.845309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1f7a-3a67-4465-91d0-edad5e3f35ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.845586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1f7a-3a67-4465-91d0-edad5e3f35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.845883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1f7a-3a67-4465-91d0-edad5e3f35ee admin admin] PATH_INFO: `/v3/projects/c35a70092d3d43ca9a65ffe2c9218ea6/users/a2464cb0617048a9a6a4bff8872e0361/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.860865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e1f7a-3a67-4465-91d0-edad5e3f35ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35a70092d3d43ca9a65ffe2c9218ea6, user_id=a2464cb0617048a9a6a4bff8872e0361, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:07.861906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING py.warnings [None req-613e1f7a-3a67-4465-91d0-edad5e3f35ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:07.861906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: warnings.warn(msg) May 12 11:41:07.861906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: May 12 11:41:07.863829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e1f7a-3a67-4465-91d0-edad5e3f35ee admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:07.877178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 753/1501] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:41:07 2022] PUT /identity/v3/projects/c35a70092d3d43ca9a65ffe2c9218ea6/users/a2464cb0617048a9a6a4bff8872e0361/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:41:07.888348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815e60-cc48-4965-8ef9-273d2fd6f2f8 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.888641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815e60-cc48-4965-8ef9-273d2fd6f2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.888919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815e60-cc48-4965-8ef9-273d2fd6f2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.913864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-aa815e60-cc48-4965-8ef9-273d2fd6f2f8 None None] MFA Rules not processed for user `a2464cb0617048a9a6a4bff8872e0361`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:41:07.915557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-aa815e60-cc48-4965-8ef9-273d2fd6f2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:41:07.980225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 749/1502] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:41:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:41:07.993962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e66b1-8289-4732-90cb-df412e4f4271 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:07.994257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e66b1-8289-4732-90cb-df412e4f4271 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:07.994558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e66b1-8289-4732-90cb-df412e4f4271 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:07.995982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 754/1503] 10.222.0.58 () {54 vars in 963 bytes} [Thu May 12 11:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:41:08.000761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e255ee-79a5-466e-8290-7c784c4fbbd1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:08.001050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e255ee-79a5-466e-8290-7c784c4fbbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:08.001325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e255ee-79a5-466e-8290-7c784c4fbbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:08.018701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-82e255ee-79a5-466e-8290-7c784c4fbbd1 None None] MFA Rules not processed for user `d990142782ed4f2f92e51c2a76693009`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:41:08.019808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-82e255ee-79a5-466e-8290-7c784c4fbbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:41:08.068713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 750/1504] 10.222.0.58 () {58 vars in 1060 bytes} [Thu May 12 11:41:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:41:08.076225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e66b1-8289-4732-90cb-df412e4f4271 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:08.086788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e66b1-8289-4732-90cb-df412e4f4271 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:08.090249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:08.090862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:08.091142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:08.091415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:08.099340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:08.100749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:08.109758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 755/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:41:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:41:08.155040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb943e-8948-4843-b4ea-64fcc043916d None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:08.155360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb943e-8948-4843-b4ea-64fcc043916d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:08.155984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb943e-8948-4843-b4ea-64fcc043916d None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:08.157287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 751/1506] 10.222.0.58 () {52 vars in 829 bytes} [Thu May 12 11:41:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:41:08.161121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:08.220805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95611f8a-b2fa-4ed0-b21a-3f0c93da258c service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:08.225269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:08.226161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:08.226442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:08.226712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] PATH_INFO: `/v3/users/a2464cb0617048a9a6a4bff8872e0361` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:08.228541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2464cb0617048a9a6a4bff8872e0361)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:08.229551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING py.warnings [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:08.229551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: warnings.warn(msg) May 12 11:41:08.229551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: May 12 11:41:08.230785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:08.294254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2464cb0617048a9a6a4bff8872e0361'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.303271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2464cb0617048a9a6a4bff8872e0361'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.303969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2464cb0617048a9a6a4bff8872e0361'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.321182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2464cb0617048a9a6a4bff8872e0361'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.321953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2464cb0617048a9a6a4bff8872e0361'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.339811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 756/1507] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:41:08 2022] DELETE /identity/v3/users/a2464cb0617048a9a6a4bff8872e0361 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:41:08.344350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:08.344643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:08.344925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:08.362730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:41:08.363911 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:41:08.425139 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 752/1508] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:41:08.434683 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:08.436122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:41:08.491294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a70eb-1c06-4e43-a2d9-e8a7fb5b718e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:08.494870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea6a8d-eca0-48e6-8583-9858df89e6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:08.495505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea6a8d-eca0-48e6-8583-9858df89e6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:08.495787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea6a8d-eca0-48e6-8583-9858df89e6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:08.496064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea6a8d-eca0-48e6-8583-9858df89e6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:08.504895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea6a8d-eca0-48e6-8583-9858df89e6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:08.506369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea6a8d-eca0-48e6-8583-9858df89e6d7 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:08.516081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 757/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:41:08.830210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:41:08.832043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:41:08.844440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a071b5-a94e-40eb-b2b2-208516afec92 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:41:08.848964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:41:08.849852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:41:08.850138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:41:08.850417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] PATH_INFO: `/v3/projects/c35a70092d3d43ca9a65ffe2c9218ea6` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:41:08.851604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35a70092d3d43ca9a65ffe2c9218ea6)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:41:08.852815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:41:08.852815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:41:08.852815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:41:08.854026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:41:08.913534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35a70092d3d43ca9a65ffe2c9218ea6', 'request_id': 'req-47086f9b-24f4-4370-9794-216c387af062'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.922700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35a70092d3d43ca9a65ffe2c9218ea6', 'request_id': 'req-47086f9b-24f4-4370-9794-216c387af062'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.936361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35a70092d3d43ca9a65ffe2c9218ea6', 'request_id': 'req-47086f9b-24f4-4370-9794-216c387af062'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.947540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] The token cache is being invalidate because project c35a70092d3d43ca9a65ffe2c9218ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:41:08.947826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.948480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-47086f9b-24f4-4370-9794-216c387af062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:41:08.950254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 753/1510] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:41:08 2022] DELETE /identity/v3/projects/c35a70092d3d43ca9a65ffe2c9218ea6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:42:51.348398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50436ec-5926-40c4-98a7-f93e56be9767 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:51.349061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50436ec-5926-40c4-98a7-f93e56be9767 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:51.349061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50436ec-5926-40c4-98a7-f93e56be9767 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:51.350369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:42:51.355072 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650524d4-5bb2-4f13-a010-e715a3eed822 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:51.355506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650524d4-5bb2-4f13-a010-e715a3eed822 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:51.355664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650524d4-5bb2-4f13-a010-e715a3eed822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:51.373856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-650524d4-5bb2-4f13-a010-e715a3eed822 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:42:51.375080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-650524d4-5bb2-4f13-a010-e715a3eed822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:42:51.430589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:42:51.609938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50436ec-5926-40c4-98a7-f93e56be9767 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:42:51.611547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d50436ec-5926-40c4-98a7-f93e56be9767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:42:51.682770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50436ec-5926-40c4-98a7-f93e56be9767 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:42:51.688005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377f52e-5be2-4d89-9e16-aeea8c25ef4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:42:51.688633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f52e-5be2-4d89-9e16-aeea8c25ef4b service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:51.688915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f52e-5be2-4d89-9e16-aeea8c25ef4b service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:51.689190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f52e-5be2-4d89-9e16-aeea8c25ef4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:51.696939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377f52e-5be2-4d89-9e16-aeea8c25ef4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:42:51.698550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377f52e-5be2-4d89-9e16-aeea8c25ef4b service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:42:51.708054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 759/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:42:51.924037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d84a-b4f1-4b41-83e6-374251b7c21c None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:51.924286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d84a-b4f1-4b41-83e6-374251b7c21c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:51.924568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d84a-b4f1-4b41-83e6-374251b7c21c None None] PATH_INFO: `/v3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:51.925915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 755/1514] 10.222.0.35 () {54 vars in 925 bytes} [Thu May 12 11:42:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:42:51.932143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd0ad2-54bf-4511-a8d1-3658c557e77f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:51.932432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd0ad2-54bf-4511-a8d1-3658c557e77f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:51.932706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd0ad2-54bf-4511-a8d1-3658c557e77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:51.951133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-57dd0ad2-54bf-4511-a8d1-3658c557e77f None None] MFA Rules not processed for user `aa6eb30499054f368f00f38c946d7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:42:51.952345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-57dd0ad2-54bf-4511-a8d1-3658c557e77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:42:52.014345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 760/1515] 10.222.0.35 () {58 vars in 1015 bytes} [Thu May 12 11:42:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:42:52.597563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844db70-6b0b-4780-aa5d-9a75c2eec39b None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:52.598140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844db70-6b0b-4780-aa5d-9a75c2eec39b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:52.598260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844db70-6b0b-4780-aa5d-9a75c2eec39b None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:52.599545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 756/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:42:52.604194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37641a8-3e9c-489d-ad1d-703c86dc0b6b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:52.604636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37641a8-3e9c-489d-ad1d-703c86dc0b6b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:52.604763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37641a8-3e9c-489d-ad1d-703c86dc0b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:52.622569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d37641a8-3e9c-489d-ad1d-703c86dc0b6b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:42:52.623797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d37641a8-3e9c-489d-ad1d-703c86dc0b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:42:52.631579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 761/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:42:52.782217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844db70-6b0b-4780-aa5d-9a75c2eec39b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:42:52.796121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844db70-6b0b-4780-aa5d-9a75c2eec39b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:42:52.801499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e110c-b8b1-4892-a978-a28263a9c29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:42:52.802157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e110c-b8b1-4892-a978-a28263a9c29b service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:42:52.802443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e110c-b8b1-4892-a978-a28263a9c29b service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:42:52.802718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e110c-b8b1-4892-a978-a28263a9c29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:42:52.811163 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e110c-b8b1-4892-a978-a28263a9c29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:42:52.812768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e110c-b8b1-4892-a978-a28263a9c29b service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:42:52.821998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 757/1518] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:43:00.870831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f651bb-297b-47fb-b01f-c607f0401f3a None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:00.871389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f651bb-297b-47fb-b01f-c607f0401f3a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:00.871389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f651bb-297b-47fb-b01f-c607f0401f3a None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:00.872697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 762/1519] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 12 11:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:43:00.877671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26aba-312b-42f1-be37-c22546b94a27 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:00.878116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26aba-312b-42f1-be37-c22546b94a27 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:00.878257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26aba-312b-42f1-be37-c22546b94a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:00.896549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-54c26aba-312b-42f1-be37-c22546b94a27 None None] MFA Rules not processed for user `aa6eb30499054f368f00f38c946d7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:43:00.897778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-54c26aba-312b-42f1-be37-c22546b94a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:00.906774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 758/1520] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 12 11:43:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:43:00.915276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f651bb-297b-47fb-b01f-c607f0401f3a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:43:00.929013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f651bb-297b-47fb-b01f-c607f0401f3a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:43:00.934242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af73bf6-0285-4b76-9de9-89d770001b22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:43:00.934866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af73bf6-0285-4b76-9de9-89d770001b22 service placement] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:00.935149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af73bf6-0285-4b76-9de9-89d770001b22 service placement] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:00.935427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af73bf6-0285-4b76-9de9-89d770001b22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:00.943540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af73bf6-0285-4b76-9de9-89d770001b22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:43:00.945131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af73bf6-0285-4b76-9de9-89d770001b22 service placement] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:43:00.955155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 763/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:43:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:43:04.125032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8669ee-adc8-45e0-9056-9ee1b8dc7cb5 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:04.125610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8669ee-adc8-45e0-9056-9ee1b8dc7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:04.125610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8669ee-adc8-45e0-9056-9ee1b8dc7cb5 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:04.126976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:43:04.131642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e740-9761-4d2c-a463-9de4fc1212d3 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:04.132084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e740-9761-4d2c-a463-9de4fc1212d3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:04.132193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e740-9761-4d2c-a463-9de4fc1212d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:04.151968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3ec2e740-9761-4d2c-a463-9de4fc1212d3 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:43:04.153657 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3ec2e740-9761-4d2c-a463-9de4fc1212d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:04.161436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:43:04.314411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8669ee-adc8-45e0-9056-9ee1b8dc7cb5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:43:04.328230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8669ee-adc8-45e0-9056-9ee1b8dc7cb5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:43:04.333405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864563-53cc-47ca-8550-b95530f9321c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:43:04.334053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864563-53cc-47ca-8550-b95530f9321c service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:04.334333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864563-53cc-47ca-8550-b95530f9321c service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:04.334604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864563-53cc-47ca-8550-b95530f9321c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:04.343174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864563-53cc-47ca-8550-b95530f9321c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:43:04.344753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864563-53cc-47ca-8550-b95530f9321c service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:43:04.353791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 760/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:43:05.250548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e51d-eb40-44c1-b80b-051febf7ed8f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:05.251098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e51d-eb40-44c1-b80b-051febf7ed8f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:05.251098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e51d-eb40-44c1-b80b-051febf7ed8f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:05.252459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 11:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:43:05.257291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cc0b-ae95-47ea-911e-82c21cb4ae1b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:05.257723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cc0b-ae95-47ea-911e-82c21cb4ae1b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:05.257888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cc0b-ae95-47ea-911e-82c21cb4ae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:05.275349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7dd1cc0b-ae95-47ea-911e-82c21cb4ae1b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:43:05.276553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7dd1cc0b-ae95-47ea-911e-82c21cb4ae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:05.284280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 11:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:43:05.434314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e51d-eb40-44c1-b80b-051febf7ed8f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:43:05.448407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e51d-eb40-44c1-b80b-051febf7ed8f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:43:05.453897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186beb6c-60ff-491b-be54-d0b7d48c240b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:43:05.454531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186beb6c-60ff-491b-be54-d0b7d48c240b service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:05.454817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186beb6c-60ff-491b-be54-d0b7d48c240b service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:05.455097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186beb6c-60ff-491b-be54-d0b7d48c240b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:05.463613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186beb6c-60ff-491b-be54-d0b7d48c240b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:43:05.465236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186beb6c-60ff-491b-be54-d0b7d48c240b service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:43:05.474452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 766/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:43:09.793520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3ec6-1ab0-42ff-a913-7e567aa77a1d None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:09.794057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3ec6-1ab0-42ff-a913-7e567aa77a1d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:09.794057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3ec6-1ab0-42ff-a913-7e567aa77a1d None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:09.795409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:43:09.800437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e395f-4de9-4820-a4ea-7e80f76bf8f3 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:09.800826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e395f-4de9-4820-a4ea-7e80f76bf8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:09.801003 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e395f-4de9-4820-a4ea-7e80f76bf8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:09.819027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c45e395f-4de9-4820-a4ea-7e80f76bf8f3 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:43:09.820224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c45e395f-4de9-4820-a4ea-7e80f76bf8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:09.827992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:43:09.864572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3ec6-1ab0-42ff-a913-7e567aa77a1d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:43:09.867745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-80cd3ec6-1ab0-42ff-a913-7e567aa77a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:09.925654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3ec6-1ab0-42ff-a913-7e567aa77a1d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:43:09.929139 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81c09a-8fce-4bb6-863e-87eb9d3f5c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:43:09.929802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c09a-8fce-4bb6-863e-87eb9d3f5c4d service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:09.930086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c09a-8fce-4bb6-863e-87eb9d3f5c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:09.930360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c09a-8fce-4bb6-863e-87eb9d3f5c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:09.939486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81c09a-8fce-4bb6-863e-87eb9d3f5c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:43:09.940904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81c09a-8fce-4bb6-863e-87eb9d3f5c4d service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:43:09.949950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 763/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:43:12.152481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69e8bd-fe5e-4bd6-9a05-da9203c9824f None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:12.153045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69e8bd-fe5e-4bd6-9a05-da9203c9824f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:12.153045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69e8bd-fe5e-4bd6-9a05-da9203c9824f None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:12.154509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:43:12.159902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531250-e461-46e9-8b9a-6a4272bdc175 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:12.160324 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531250-e461-46e9-8b9a-6a4272bdc175 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:12.160488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531250-e461-46e9-8b9a-6a4272bdc175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:12.178320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-31531250-e461-46e9-8b9a-6a4272bdc175 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:43:12.179503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-31531250-e461-46e9-8b9a-6a4272bdc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:12.187716 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:43:12.222172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69e8bd-fe5e-4bd6-9a05-da9203c9824f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:43:12.233280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69e8bd-fe5e-4bd6-9a05-da9203c9824f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:43:12.236726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f356b-b7d4-4387-943a-2cba4031676c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:43:12.237345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f356b-b7d4-4387-943a-2cba4031676c service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:12.237624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f356b-b7d4-4387-943a-2cba4031676c service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:12.237924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f356b-b7d4-4387-943a-2cba4031676c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:12.247053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f356b-b7d4-4387-943a-2cba4031676c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:43:12.248480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f356b-b7d4-4387-943a-2cba4031676c service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:43:12.257622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 769/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:43:16.065843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aac7d-a377-4354-9c2f-407ce6813d0e None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:16.066372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aac7d-a377-4354-9c2f-407ce6813d0e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:16.066469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aac7d-a377-4354-9c2f-407ce6813d0e None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:16.067842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:43:16.074267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ef91-9dcf-4374-b077-96e686aebba8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:16.074707 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ef91-9dcf-4374-b077-96e686aebba8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:16.074844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ef91-9dcf-4374-b077-96e686aebba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:16.092346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-28a3ef91-9dcf-4374-b077-96e686aebba8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:43:16.093521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-28a3ef91-9dcf-4374-b077-96e686aebba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:16.101115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:43:16.372733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aac7d-a377-4354-9c2f-407ce6813d0e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:43:16.374425 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-550aac7d-a377-4354-9c2f-407ce6813d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:16.429578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aac7d-a377-4354-9c2f-407ce6813d0e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:43:16.433723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6a642-5636-42fb-bc0c-eb440622ea3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:43:16.434373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a642-5636-42fb-bc0c-eb440622ea3f service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:16.434655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a642-5636-42fb-bc0c-eb440622ea3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:16.434931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a642-5636-42fb-bc0c-eb440622ea3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:16.443625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6a642-5636-42fb-bc0c-eb440622ea3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:43:16.445049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6a642-5636-42fb-bc0c-eb440622ea3f service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:43:16.454310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 766/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:43:18.712462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127143-d5fe-4bde-9dbe-e4b37d01cc9c None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:18.713027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127143-d5fe-4bde-9dbe-e4b37d01cc9c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:18.713027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127143-d5fe-4bde-9dbe-e4b37d01cc9c None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:18.714548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 11:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:43:18.719812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8ec1b-126b-455b-8921-1c91a1f01fa1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:18.720245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8ec1b-126b-455b-8921-1c91a1f01fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:18.720359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8ec1b-126b-455b-8921-1c91a1f01fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:18.738409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-fbe8ec1b-126b-455b-8921-1c91a1f01fa1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:43:18.739592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fbe8ec1b-126b-455b-8921-1c91a1f01fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:18.749028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 11:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:43:19.015034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127143-d5fe-4bde-9dbe-e4b37d01cc9c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:43:19.016701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-cf127143-d5fe-4bde-9dbe-e4b37d01cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:43:19.029804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127143-d5fe-4bde-9dbe-e4b37d01cc9c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:43:19.033429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb438-48bd-4636-8237-094c54fd5cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:43:19.034086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb438-48bd-4636-8237-094c54fd5cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:43:19.034362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb438-48bd-4636-8237-094c54fd5cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:43:19.034631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb438-48bd-4636-8237-094c54fd5cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:43:19.043888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb438-48bd-4636-8237-094c54fd5cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:43:19.045306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb438-48bd-4636-8237-094c54fd5cc9 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:43:19.054237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 772/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:52.115787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292f6a1-31aa-4c84-b1e9-1c4b5d924e66 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.116412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292f6a1-31aa-4c84-b1e9-1c4b5d924e66 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.116412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292f6a1-31aa-4c84-b1e9-1c4b5d924e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.147667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8292f6a1-31aa-4c84-b1e9-1c4b5d924e66 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.148880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8292f6a1-31aa-4c84-b1e9-1c4b5d924e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.161907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 768/1540] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.171570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dba1-16b5-4fe0-90ba-b55ce8e0d24c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.172154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dba1-16b5-4fe0-90ba-b55ce8e0d24c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.172154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dba1-16b5-4fe0-90ba-b55ce8e0d24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.179493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644818c-ca84-4de7-b9be-5df4a6d18b19 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.179794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644818c-ca84-4de7-b9be-5df4a6d18b19 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.180079 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644818c-ca84-4de7-b9be-5df4a6d18b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.197253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a798dba1-16b5-4fe0-90ba-b55ce8e0d24c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.204586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a798dba1-16b5-4fe0-90ba-b55ce8e0d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.206299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e644818c-ca84-4de7-b9be-5df4a6d18b19 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.207662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e644818c-ca84-4de7-b9be-5df4a6d18b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.213615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 773/1541] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:44:52.218488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798dba1-16b5-4fe0-90ba-b55ce8e0d24c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.219558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 769/1542] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:44:52.230924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad9c2-86b9-48e7-869f-89d32c884dba None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.231235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad9c2-86b9-48e7-869f-89d32c884dba None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.231497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ad9c2-86b9-48e7-869f-89d32c884dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.232541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798dba1-16b5-4fe0-90ba-b55ce8e0d24c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.243389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.244067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.244352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.244627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.245737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.245737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.246687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING py.warnings [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:44:52.246687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: warnings.warn(msg) May 12 11:44:52.246687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: May 12 11:44:52.247584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eda6bc-6027-4629-8527-6c0326baf426 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.257994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c66ad9c2-86b9-48e7-869f-89d32c884dba None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.259539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c66ad9c2-86b9-48e7-869f-89d32c884dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.265810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 774/1543] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.267195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685077-fe65-4b20-a167-a61f1c51aa6c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.267474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685077-fe65-4b20-a167-a61f1c51aa6c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.267755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685077-fe65-4b20-a167-a61f1c51aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.269454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 770/1544] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.275221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c3320-ccaa-42f0-bc15-e4493f9a518b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.275641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c3320-ccaa-42f0-bc15-e4493f9a518b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.275929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c3320-ccaa-42f0-bc15-e4493f9a518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.288915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c6685077-fe65-4b20-a167-a61f1c51aa6c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.290063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c6685077-fe65-4b20-a167-a61f1c51aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.294106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bb3c3320-ccaa-42f0-bc15-e4493f9a518b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.295275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bb3c3320-ccaa-42f0-bc15-e4493f9a518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.297809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 775/1545] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.299537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a170f2c-4b1a-4508-aa88-fe3b186d5463 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.299825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a170f2c-4b1a-4508-aa88-fe3b186d5463 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.300099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a170f2c-4b1a-4508-aa88-fe3b186d5463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.305388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 771/1546] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.306975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae454-67f5-496b-b875-9944f0815eaf None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.306975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae454-67f5-496b-b875-9944f0815eaf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.307203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae454-67f5-496b-b875-9944f0815eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.320076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3a170f2c-4b1a-4508-aa88-fe3b186d5463 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.321260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3a170f2c-4b1a-4508-aa88-fe3b186d5463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.326053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f7bae454-67f5-496b-b875-9944f0815eaf None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.327186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f7bae454-67f5-496b-b875-9944f0815eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.329590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 776/1547] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.330833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1c49-9f16-418a-b0c4-e307e9bffb9d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.331123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1c49-9f16-418a-b0c4-e307e9bffb9d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.331405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1c49-9f16-418a-b0c4-e307e9bffb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.339773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 772/1548] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.340432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bae454-67f5-496b-b875-9944f0815eaf None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.349432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bae454-67f5-496b-b875-9944f0815eaf None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.351800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0c2e1c49-9f16-418a-b0c4-e307e9bffb9d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.353088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0c2e1c49-9f16-418a-b0c4-e307e9bffb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.353884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df9071-815d-458f-94f2-e9db25223ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.354544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df9071-815d-458f-94f2-e9db25223ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.354819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df9071-815d-458f-94f2-e9db25223ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.355090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df9071-815d-458f-94f2-e9db25223ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.355823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df9071-815d-458f-94f2-e9db25223ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.356756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-04df9071-815d-458f-94f2-e9db25223ecc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:44:52.356756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:44:52.356756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:44:52.357961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df9071-815d-458f-94f2-e9db25223ecc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.361541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 777/1549] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.362814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce613e-8d7e-42b3-9bbc-dd98cfd69141 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.363092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce613e-8d7e-42b3-9bbc-dd98cfd69141 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.363367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce613e-8d7e-42b3-9bbc-dd98cfd69141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.381615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-89ce613e-8d7e-42b3-9bbc-dd98cfd69141 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.383096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-89ce613e-8d7e-42b3-9bbc-dd98cfd69141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.386995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 773/1550] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:52.386995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7571adb-cc4a-477f-9a91-09b4f3a81872 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.386995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7571adb-cc4a-477f-9a91-09b4f3a81872 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.386995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7571adb-cc4a-477f-9a91-09b4f3a81872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.403071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c7571adb-cc4a-477f-9a91-09b4f3a81872 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.404396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c7571adb-cc4a-477f-9a91-09b4f3a81872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.439652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 778/1551] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.441196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b94be-d4fa-4275-8683-fc96fab33539 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.441799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b94be-d4fa-4275-8683-fc96fab33539 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.441799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b94be-d4fa-4275-8683-fc96fab33539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.465298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-476b94be-d4fa-4275-8683-fc96fab33539 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.465898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 774/1552] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.466544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-476b94be-d4fa-4275-8683-fc96fab33539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.467391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7321-dae3-46f2-9742-b3758590255b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.467620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7321-dae3-46f2-9742-b3758590255b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.467897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7321-dae3-46f2-9742-b3758590255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.475804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 779/1553] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.477025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82012b-9c5e-4b61-96d4-62289b823432 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.477368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82012b-9c5e-4b61-96d4-62289b823432 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.477651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82012b-9c5e-4b61-96d4-62289b823432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.485990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-a58d7321-dae3-46f2-9742-b3758590255b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.487662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a58d7321-dae3-46f2-9742-b3758590255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.495101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8f82012b-9c5e-4b61-96d4-62289b823432 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.495549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 775/1554] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.496133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d7321-dae3-46f2-9742-b3758590255b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.496254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8f82012b-9c5e-4b61-96d4-62289b823432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.504824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 780/1555] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.506099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfb8af-26b6-4dda-97ee-c50d0699a539 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.506387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfb8af-26b6-4dda-97ee-c50d0699a539 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.506665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfb8af-26b6-4dda-97ee-c50d0699a539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.509125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d7321-dae3-46f2-9742-b3758590255b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.515119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.515561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.515839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.516109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.516879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.517177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.518867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.524897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f6bfb8af-26b6-4dda-97ee-c50d0699a539 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.526109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f6bfb8af-26b6-4dda-97ee-c50d0699a539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.530392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 776/1556] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.531187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.537833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 781/1557] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.539456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736047-6fa7-4ddf-bb66-ac1c5aebaf3e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.539687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736047-6fa7-4ddf-bb66-ac1c5aebaf3e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.539971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736047-6fa7-4ddf-bb66-ac1c5aebaf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.541237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d70f2-8ad5-48a0-8025-954d71549971 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.545642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.546303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.546577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.546849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.547519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.550064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.558419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-af736047-6fa7-4ddf-bb66-ac1c5aebaf3e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:52.559609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-af736047-6fa7-4ddf-bb66-ac1c5aebaf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:52.567534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 782/1558] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:52.568311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736047-6fa7-4ddf-bb66-ac1c5aebaf3e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.573793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 777/1559] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:52.574938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.577477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736047-6fa7-4ddf-bb66-ac1c5aebaf3e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.582369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.583001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.583282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.583558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.584310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.584550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b87eba-1376-447c-b451-729de77bcde7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.584708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.586243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.589180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.589847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.590134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.590412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.591124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.591429 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.592995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.598042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 783/1560] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.598835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.608243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2d41-80af-4c6d-a778-9c69c124b62a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.609600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 778/1561] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.610342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.620069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1dc55-5922-4ffd-bfe4-931c789a8b24 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.620441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.621098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.621403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.621678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.622452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.622756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.624336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.624536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.625152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.625428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.625726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.626460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.626759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.628343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.636111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 784/1562] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.636932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.640017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 779/1563] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.640978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.648170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c6779-f3fc-451e-9da2-3861489a965b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.651980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61986c-068d-48f1-acea-529c22d317bc admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.652784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.653419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.653721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.654011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.654708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.655009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.656722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.656903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.658113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.658401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.658681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.659366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.661300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.668760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 785/1564] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.669609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.685590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95939f-d855-42c6-94a7-2d93e7aa50e0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.690078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 780/1565] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:52.690078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.742128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.742789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.743082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.743359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.744118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:44:52.744425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.746110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.747682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12e37-3479-49c0-b48a-e361a452eb00 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.752863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.753520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.753834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.754116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.754835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.756420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.757928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 786/1566] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:44:52.758665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.769692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 781/1567] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:52.769692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.769999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909d1ee-7188-425e-b7ad-96180393aa91 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.774445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.775091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.775520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.775805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.776523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.777140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3441635-f415-4aff-b381-183aae61a6e4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.778479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.781923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.782700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.782980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.783257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.783933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.785837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.805878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 787/1568] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:52.806918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.812216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 782/1569] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:52.813015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.869802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6223d6-578d-44f0-bb23-5d637c86bf6b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.874547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.875205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.875389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d712d-1eae-418d-92ec-461cdbca36ac admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.875497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.875746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.877048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.878990 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.880797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.881398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.881677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.881989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.882665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.884550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.903891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 788/1570] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:52.904876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.912034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 783/1571] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:52.912848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:52.967701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a3b2c-0641-40bd-82df-6259195b1098 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.973436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.974179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.974464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.974738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.974850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5c3c-0234-4855-92f3-0142aeb6eb76 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:52.975437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.977459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:52.979914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:52.980593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:52.980870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:52.982519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:52.982519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:52.983885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.005743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 784/1572] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.006228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 789/1573] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:52 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.006545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.007503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.017955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b233-26cc-47e1-89e9-c22f023dad63 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.068459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12268-e5c2-4192-959a-b3d0d94f7382 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.072095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.072755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.072973 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.073086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.073304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.073618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.073930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.074054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.074202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.074921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.075934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.076514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.086600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 790/1574] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.090469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.100544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e08ba-55e8-41b1-9ee1-a381f2b09746 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.103208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 785/1575] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.104005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.108065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.108708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.108989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.109258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.109952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.111505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING py.warnings [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:44:53.111505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: warnings.warn(msg) May 12 11:44:53.111505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: May 12 11:44:53.112700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.132067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 791/1576] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.132844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.142042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab12f-f5d5-4369-85fc-e6e65256ea15 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.167444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15479c-0503-4fe7-b610-d2629eead756 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.172770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.174032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.174313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.174584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.175265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.177170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.199058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 786/1577] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.199058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.199635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.200307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.200604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.200867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.201587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.203569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.206298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f87b-c9e7-4bda-921d-d8d72b909ef9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.211105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.211838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.212194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.212532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.213274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.215281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.224528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 792/1578] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.225447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.239116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 787/1579] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.239305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187416-5586-4dd3-9240-ab308aa327f5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.239396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.241656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.242341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.242625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.243384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.243617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.245214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.246529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2cb3-bb33-4394-a85a-b6fb23d87a25 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.251042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.251679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.251955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.252232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.253090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.255036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.255405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 793/1580] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.256208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.266077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143fe10-62c1-4f7a-9df3-ccfec0b8923a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.271423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.272302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.272572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.272853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] PATH_INFO: `/v3/projects/0c4f8e1511da40a78043126239818bb5/users/5c89c3dea13a43c88d725876f67dfba2/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.277673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 788/1581] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.277673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.285951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36807-e286-41f7-bc9a-e322e3fd9413 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.288082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4f8e1511da40a78043126239818bb5, user_id=5c89c3dea13a43c88d725876f67dfba2, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.290515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.290817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.291158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.291446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.291728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.292412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.294340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.305321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 794/1582] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:53 2022] PUT /identity/v3/projects/0c4f8e1511da40a78043126239818bb5/users/5c89c3dea13a43c88d725876f67dfba2/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:53.306466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.328090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 789/1583] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.328090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.336297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b040f-10a6-467e-8477-4f99a4d1cbbc admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.370179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea039575-8f44-4fd8-b5ab-9ca6af704dee admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.374777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.375431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.375716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.376041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.376761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.378409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.387863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 795/1584] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.388724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.390951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.391647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.391932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.392209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.392931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.394560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.397988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8ad0f-ea9f-40fb-833d-41ce1eb1fdbc admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.402514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.403133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.403419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.403697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.404313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 790/1585] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.404432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.406145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.408943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.419107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 796/1586] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.419107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.419356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199e4f-5097-4739-a2a0-33b8de15c2ae admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.423519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.424286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.424593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.424867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.425596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.427159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccf36f-d5eb-4a35-a382-7dbf307eacb8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.427266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.431613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d73be-41d0-4d1e-aa5a-31efa7dd764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.432234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d73be-41d0-4d1e-aa5a-31efa7dd764c admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.432521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d73be-41d0-4d1e-aa5a-31efa7dd764c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.432800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d73be-41d0-4d1e-aa5a-31efa7dd764c admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.433500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d73be-41d0-4d1e-aa5a-31efa7dd764c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.435187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d73be-41d0-4d1e-aa5a-31efa7dd764c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.436769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 791/1587] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.437537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.448068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 797/1588] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.448068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423b21d-f51c-4726-9a95-f3317e575e64 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.448331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066d595-7a71-4f76-a625-38d0b793f5c7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.448424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423b21d-f51c-4726-9a95-f3317e575e64 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.448424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423b21d-f51c-4726-9a95-f3317e575e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.452754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.453411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.453692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.454266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.454996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.456620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.467004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 792/1589] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.467781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.473468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7423b21d-f51c-4726-9a95-f3317e575e64 None None] MFA Rules not processed for user `5c89c3dea13a43c88d725876f67dfba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:53.474703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7423b21d-f51c-4726-9a95-f3317e575e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:53.477355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77fb9-edcd-4a85-a74c-55a9c1fc65eb admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.481906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.482529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.482808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.483079 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.483780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.485322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.495810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 793/1590] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.496461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.508782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83dc62-402e-4873-8760-b6280049f16f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.513493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.514177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.514459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.514737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.515484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.517570 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.527351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 794/1591] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.527928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.537514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8c52-95ea-4da2-921a-570ccc0d16e3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.542024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.542648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.542936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.543213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.543907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.545599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 798/1592] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:53.545733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.546610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423b21d-f51c-4726-9a95-f3317e575e64 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.555512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 795/1593] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.556296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.559156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423b21d-f51c-4726-9a95-f3317e575e64 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.563648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.564289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.564567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.564838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.565438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450d4d-bec0-43f3-9b20-be21103068e4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.565551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.567281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.570054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.570695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.571015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.571294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.572018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.573584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.577065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 799/1594] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.577864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.587105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 796/1595] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.587105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.589655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6a1d-952b-4bef-a047-fd7bda967ec4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.594156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b8ab-51ee-4e6e-9d68-2353750bd61e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.594731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.596146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.596429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.596706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] PATH_INFO: `/v3/projects/4af23c89d27f4dd8bbd6d1f6ce716d0f/users/2202a18ec7ca43719af92bacb746cd6c/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.599312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.599941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.600225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.600499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.601214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.602835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.611688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af23c89d27f4dd8bbd6d1f6ce716d0f, user_id=2202a18ec7ca43719af92bacb746cd6c, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.613044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 797/1596] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.613860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.614406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.623805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa35f7-7031-4a09-854d-2a54a4205111 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.627737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 800/1597] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:53 2022] PUT /identity/v3/projects/4af23c89d27f4dd8bbd6d1f6ce716d0f/users/2202a18ec7ca43719af92bacb746cd6c/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:53.628512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.678598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.679409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.679699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.679981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.680739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.682644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.691805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87026024-b49c-445b-9183-c0fe01add8cb admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.692758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 798/1598] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:53.693681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.697504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.698435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.698722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.699000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] PATH_INFO: `/v3/projects/9ac9e0f81ffb4e37a6dfa644500012a3/users/0eaa0f64a1c24f39a8f994bdd2eeae86/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.702843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4b46-ed1c-4efd-9f9b-e2854a8410f9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.707606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.708229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.708511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.708784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.709452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.711363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.713839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac9e0f81ffb4e37a6dfa644500012a3, user_id=0eaa0f64a1c24f39a8f994bdd2eeae86, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.716508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.730443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 801/1599] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:53 2022] PUT /identity/v3/projects/9ac9e0f81ffb4e37a6dfa644500012a3/users/0eaa0f64a1c24f39a8f994bdd2eeae86/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:53.731253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.743922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 799/1600] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:53.745085 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.790031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09345970-23a5-4e5e-b8e5-3098a4ef3120 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.804160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d0d2-43b5-4008-be59-f748dfdfe745 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.808746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.809620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.809931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.810217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] PATH_INFO: `/v3/projects/4b52f1a625344430ba655dc6c40eebb3/users/3fc5418744ce43cf8074de1d2f0de6cf/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.826860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b52f1a625344430ba655dc6c40eebb3, user_id=3fc5418744ce43cf8074de1d2f0de6cf, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.827889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:44:53.827889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:44:53.827889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:44:53.830172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.842919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 800/1601] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:53 2022] PUT /identity/v3/projects/4b52f1a625344430ba655dc6c40eebb3/users/3fc5418744ce43cf8074de1d2f0de6cf/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:53.843748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.847925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.848871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.849157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.849426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] PATH_INFO: `/v3/projects/079cb1c02174440091d4c5bcbc27bdc5/users/635d1cf64110483b843b01e6e6ddc749/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.864962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=079cb1c02174440091d4c5bcbc27bdc5, user_id=635d1cf64110483b843b01e6e6ddc749, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.867789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.881621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 802/1602] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:53 2022] PUT /identity/v3/projects/079cb1c02174440091d4c5bcbc27bdc5/users/635d1cf64110483b843b01e6e6ddc749/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:53.882532 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:53.912375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9084bf-97d6-42c4-acf6-3f551c880882 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.944191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591db4e-89a1-42ec-afac-cfe5a9d4b957 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:53.948970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fb59e-c655-4961-8355-62b5f3e64eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.949883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb59e-c655-4961-8355-62b5f3e64eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.950171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb59e-c655-4961-8355-62b5f3e64eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.950453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb59e-c655-4961-8355-62b5f3e64eaa admin admin] PATH_INFO: `/v3/projects/dd154e9ddff14089b8fc96ba030e5669/users/af0e1282e6024c9c8f128a8d7b235733/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.964813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fb59e-c655-4961-8355-62b5f3e64eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd154e9ddff14089b8fc96ba030e5669, user_id=af0e1282e6024c9c8f128a8d7b235733, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.966754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:53.967654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.967789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fb59e-c655-4961-8355-62b5f3e64eaa admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:53.967972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.968232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] PATH_INFO: `/v3/projects/4cf6ee1140af40858f19f644ca836290/users/5dd78ec10aaf4031968c876c876f489d/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.981028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 803/1603] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:53 2022] PUT /identity/v3/projects/dd154e9ddff14089b8fc96ba030e5669/users/af0e1282e6024c9c8f128a8d7b235733/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:53.982302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4e1d-e470-481f-970d-2a00d10bafd5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:53.982588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4e1d-e470-481f-970d-2a00d10bafd5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:53.982973 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4e1d-e470-481f-970d-2a00d10bafd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:53.986771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf6ee1140af40858f19f644ca836290, user_id=5dd78ec10aaf4031968c876c876f489d, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:53.989437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.002477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 801/1604] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:53 2022] PUT /identity/v3/projects/4cf6ee1140af40858f19f644ca836290/users/5dd78ec10aaf4031968c876c876f489d/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:54.003257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.010567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-1f8a4e1d-e470-481f-970d-2a00d10bafd5 None None] MFA Rules not processed for user `2202a18ec7ca43719af92bacb746cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.011774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1f8a4e1d-e470-481f-970d-2a00d10bafd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.062598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d0474-2980-49f4-afa0-d1171320930d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.067412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.068297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.068608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.068887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] PATH_INFO: `/v3/projects/db981c9e8c1e4596bda2649d950ff66e/users/fc1e5d1ec35744a9a489ae26e631c65b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.074760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 804/1605] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.076135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aed4f-39d5-435b-a9bd-d02db8b803ec None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.076425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aed4f-39d5-435b-a9bd-d02db8b803ec None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.076708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aed4f-39d5-435b-a9bd-d02db8b803ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.083262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db981c9e8c1e4596bda2649d950ff66e, user_id=fc1e5d1ec35744a9a489ae26e631c65b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.085968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.099953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 802/1606] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:54 2022] PUT /identity/v3/projects/db981c9e8c1e4596bda2649d950ff66e/users/fc1e5d1ec35744a9a489ae26e631c65b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:54.100659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.102980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f92aed4f-39d5-435b-a9bd-d02db8b803ec None None] MFA Rules not processed for user `0eaa0f64a1c24f39a8f994bdd2eeae86`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.104174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f92aed4f-39d5-435b-a9bd-d02db8b803ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.159517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5c66-e7db-4556-b845-a2c77108a06d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.164086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe24b80-583f-4a16-a8ec-d5d2b271cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.164754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe24b80-583f-4a16-a8ec-d5d2b271cd03 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.165040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe24b80-583f-4a16-a8ec-d5d2b271cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.165318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe24b80-583f-4a16-a8ec-d5d2b271cd03 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.166037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe24b80-583f-4a16-a8ec-d5d2b271cd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.166307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 805/1607] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.167578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac26484-b98d-49bd-a895-ef5c4348d0c0 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.167862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac26484-b98d-49bd-a895-ef5c4348d0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.168051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe24b80-583f-4a16-a8ec-d5d2b271cd03 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.168522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac26484-b98d-49bd-a895-ef5c4348d0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.187194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7ac26484-b98d-49bd-a895-ef5c4348d0c0 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.188427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7ac26484-b98d-49bd-a895-ef5c4348d0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.193535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 803/1608] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:54.193535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b097599-619d-431d-9939-ab011c2dff3b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.193535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b097599-619d-431d-9939-ab011c2dff3b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.193535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b097599-619d-431d-9939-ab011c2dff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.200076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 806/1609] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.201472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410975-0280-44c2-b401-3595ba1509d8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.201794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410975-0280-44c2-b401-3595ba1509d8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.202076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410975-0280-44c2-b401-3595ba1509d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.211076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-2b097599-619d-431d-9939-ab011c2dff3b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.213342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2b097599-619d-431d-9939-ab011c2dff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.221042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-77410975-0280-44c2-b401-3595ba1509d8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.221366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 804/1610] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.222522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-77410975-0280-44c2-b401-3595ba1509d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.222682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650515e0-22a6-4ecc-a2bd-2ccc44d246dd None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.222953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650515e0-22a6-4ecc-a2bd-2ccc44d246dd None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.223233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650515e0-22a6-4ecc-a2bd-2ccc44d246dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.234798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 807/1611] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.234798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77410975-0280-44c2-b401-3595ba1509d8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.243392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77410975-0280-44c2-b401-3595ba1509d8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.248024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd691a83-2f30-49b7-9285-1d334aea8b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.248680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691a83-2f30-49b7-9285-1d334aea8b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.248965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691a83-2f30-49b7-9285-1d334aea8b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.249250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691a83-2f30-49b7-9285-1d334aea8b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.250079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd691a83-2f30-49b7-9285-1d334aea8b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.252290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd691a83-2f30-49b7-9285-1d334aea8b8f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.256276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-650515e0-22a6-4ecc-a2bd-2ccc44d246dd None None] MFA Rules not processed for user `5dd78ec10aaf4031968c876c876f489d`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.257460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-650515e0-22a6-4ecc-a2bd-2ccc44d246dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.278371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 808/1612] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:54.279843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01e1a-b3db-406b-a65d-7628862210c9 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.280203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01e1a-b3db-406b-a65d-7628862210c9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.280555 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01e1a-b3db-406b-a65d-7628862210c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.306845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b0d01e1a-b3db-406b-a65d-7628862210c9 None None] MFA Rules not processed for user `fc1e5d1ec35744a9a489ae26e631c65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.308148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b0d01e1a-b3db-406b-a65d-7628862210c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.324926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 805/1613] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.326494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24aa68-ec79-4d3c-ad57-95d6326d857a None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.326781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24aa68-ec79-4d3c-ad57-95d6326d857a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.327056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24aa68-ec79-4d3c-ad57-95d6326d857a None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.328299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 806/1614] 10.222.0.58 () {54 vars in 961 bytes} [Thu May 12 11:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:44:54.329289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24aa68-ec79-4d3c-ad57-95d6326d857a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.378829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 809/1615] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.379611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d01e1a-b3db-406b-a65d-7628862210c9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.391419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24aa68-ec79-4d3c-ad57-95d6326d857a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.396251 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.396910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.397196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.397473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.398243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.399854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.409614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 807/1616] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:54.410622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.412246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.431080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d01e1a-b3db-406b-a65d-7628862210c9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.434714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.435352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.435637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.435914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.445252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.446719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.457206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 810/1617] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:54.458231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.459594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.468002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181840a1-7a9c-40cb-9ae2-c0126daae14b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.471220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc267f-7ad5-4e58-8664-7c4b25af7cb0 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.472103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.472752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.473037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.473316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.475783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46cc8f-d6d7-4033-9d6e-3693ac52141d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.476655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46cc8f-d6d7-4033-9d6e-3693ac52141d service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.476939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46cc8f-d6d7-4033-9d6e-3693ac52141d service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.477211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46cc8f-d6d7-4033-9d6e-3693ac52141d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.483113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.485086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.488014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46cc8f-d6d7-4033-9d6e-3693ac52141d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.489915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46cc8f-d6d7-4033-9d6e-3693ac52141d service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.496249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 808/1618] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:54.496836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.500633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 811/1619] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:54.502575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9186-1cb9-4951-81fa-c2a2ce0c3e75 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.502859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9186-1cb9-4951-81fa-c2a2ce0c3e75 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.503131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9186-1cb9-4951-81fa-c2a2ce0c3e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.513019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a774f-d07c-4700-a5cc-0ebfeaac943f service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.519111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2769c0-ecec-4b0a-b350-59228c204c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.520164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2769c0-ecec-4b0a-b350-59228c204c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.520679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2769c0-ecec-4b0a-b350-59228c204c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.521164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2769c0-ecec-4b0a-b350-59228c204c13 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.522115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2769c0-ecec-4b0a-b350-59228c204c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.522547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-257d9186-1cb9-4951-81fa-c2a2ce0c3e75 None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.523762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-257d9186-1cb9-4951-81fa-c2a2ce0c3e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.525195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2769c0-ecec-4b0a-b350-59228c204c13 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.552236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 809/1620] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/users => generated 288 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:54.554330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96f83e-a83f-43f9-aea5-8f456cd8f470 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.555247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96f83e-a83f-43f9-aea5-8f456cd8f470 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.556365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96f83e-a83f-43f9-aea5-8f456cd8f470 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.562721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 810/1621] 10.222.0.58 () {54 vars in 961 bytes} [Thu May 12 11:44:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:44:54.564638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96f83e-a83f-43f9-aea5-8f456cd8f470 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.581917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96f83e-a83f-43f9-aea5-8f456cd8f470 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.588737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.589616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.590017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.590393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.591281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.593993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.599982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 812/1622] 10.222.0.58 () {58 vars in 1058 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.600960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9186-1cb9-4951-81fa-c2a2ce0c3e75 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.614259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9186-1cb9-4951-81fa-c2a2ce0c3e75 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.626060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895c15-d9b9-409e-bafb-a515acbeb409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.627830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895c15-d9b9-409e-bafb-a515acbeb409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.628174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895c15-d9b9-409e-bafb-a515acbeb409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.628724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895c15-d9b9-409e-bafb-a515acbeb409 admin admin] PATH_INFO: `/v3/projects/c15aa1c247e34833b5611860bb1a95b5/users/a1d84c35f15c4c2fb7ef0497e2fb3758/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.631049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 811/1623] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:54.631983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.649868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03895c15-d9b9-409e-bafb-a515acbeb409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15aa1c247e34833b5611860bb1a95b5, user_id=a1d84c35f15c4c2fb7ef0497e2fb3758, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.652754 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03895c15-d9b9-409e-bafb-a515acbeb409 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.676279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 813/1624] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:54 2022] PUT /identity/v3/projects/c15aa1c247e34833b5611860bb1a95b5/users/a1d84c35f15c4c2fb7ef0497e2fb3758/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:54.678100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48549d1-be3c-4c14-94c0-04657bb0d3aa None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.679227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48549d1-be3c-4c14-94c0-04657bb0d3aa None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.679227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48549d1-be3c-4c14-94c0-04657bb0d3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.710691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f48549d1-be3c-4c14-94c0-04657bb0d3aa None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:54.712065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f48549d1-be3c-4c14-94c0-04657bb0d3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:54.744250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba54e-d91c-4b65-b7fe-a51ab33c0d79 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.809478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 814/1625] 10.222.0.58 () {58 vars in 1058 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:54.810666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48549d1-be3c-4c14-94c0-04657bb0d3aa None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.827025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48549d1-be3c-4c14-94c0-04657bb0d3aa None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.840609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.842417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.842818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.843214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.861965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.862495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.862773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.863044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.863834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.865742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.881904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 812/1626] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:54.882791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.896823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83504e1f-40ab-4268-afc5-7891516fe1a0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.904553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.905371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.908022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.908022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.908022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.909853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.941164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 813/1627] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:54 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:54.945490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.957200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.959189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78855-5e9a-4b07-a43f-c717fed0c124 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:54.960646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.965599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:54.966877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:54.967173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:54.967534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:54.968300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:54.972729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:54.986942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 814/1628] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:54.988127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:54.998719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 815/1629] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:55.001399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.007850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead36c-ca1c-4913-a342-d7fd823bb1c7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.023354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.025096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.025096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.025677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.028777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d89c23-cc77-46f1-aaf0-c2a361f17198 service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.043553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.044459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.044735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.045006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] PATH_INFO: `/v3/projects/743147086cf04a5d8239a33de5269ede/users/516569b70fc04dbebc4ba563acd61647/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.087521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=743147086cf04a5d8239a33de5269ede, user_id=516569b70fc04dbebc4ba563acd61647, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.095261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.137121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 816/1630] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:54 2022] PUT /identity/v3/projects/743147086cf04a5d8239a33de5269ede/users/516569b70fc04dbebc4ba563acd61647/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:55.138030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.188034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.194032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.216087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 815/1631] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:55.220665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.243614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ebc6-d7e5-45d8-83df-e4c5bf99597a service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.284738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac70b-59ef-4d48-969e-e4add95a1b3c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.300374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.301290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.301575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.301885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.302621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.304350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.331702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 817/1632] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:55.332691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.350552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e584ec6-a7d6-4ad9-8399-4fa46ea8c661 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.363201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.364604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.364881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.365151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.365918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.367537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.378742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.379653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.379932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.380207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] PATH_INFO: `/v3/projects/c15aa1c247e34833b5611860bb1a95b5/users/a1d84c35f15c4c2fb7ef0497e2fb3758/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.383553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15aa1c247e34833b5611860bb1a95b5, user_id=a1d84c35f15c4c2fb7ef0497e2fb3758, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.386426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.399564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 818/1633] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:55.400538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.415318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 816/1634] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:55 2022] PUT /identity/v3/projects/c15aa1c247e34833b5611860bb1a95b5/users/a1d84c35f15c4c2fb7ef0497e2fb3758/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:55.416167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.421310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd7f6-0c64-4b17-a425-6135942f28b8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.521407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eabb8-2a3b-4b38-b009-214032752cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.522229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eabb8-2a3b-4b38-b009-214032752cec admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.522665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eabb8-2a3b-4b38-b009-214032752cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.523043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eabb8-2a3b-4b38-b009-214032752cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.523890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eabb8-2a3b-4b38-b009-214032752cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.525816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eabb8-2a3b-4b38-b009-214032752cec admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.537162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 819/1635] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:55.538635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3706c44-5726-4275-aded-540431880578 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.539178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3706c44-5726-4275-aded-540431880578 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.539579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3706c44-5726-4275-aded-540431880578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.569747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c3706c44-5726-4275-aded-540431880578 None None] MFA Rules not processed for user `a1d84c35f15c4c2fb7ef0497e2fb3758`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:55.571102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c3706c44-5726-4275-aded-540431880578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:55.577652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd18f-3606-4287-af9e-8833ca505778 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.598309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.599745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.599745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.601554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] PATH_INFO: `/v3/projects/743147086cf04a5d8239a33de5269ede/users/516569b70fc04dbebc4ba563acd61647/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.608946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=743147086cf04a5d8239a33de5269ede, user_id=516569b70fc04dbebc4ba563acd61647, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.616419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.649625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 817/1636] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:55 2022] PUT /identity/v3/projects/743147086cf04a5d8239a33de5269ede/users/516569b70fc04dbebc4ba563acd61647/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:55.651424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.691944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 820/1637] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:55.695472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773689a-c3fb-4b25-b446-7b09872969e4 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.696167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773689a-c3fb-4b25-b446-7b09872969e4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.696610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773689a-c3fb-4b25-b446-7b09872969e4 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.698864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 821/1638] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 12 11:44:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:44:55.700717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd7f08-74bf-4d0e-8057-712cfcfa76a3 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.701179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd7f08-74bf-4d0e-8057-712cfcfa76a3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.702273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd7f08-74bf-4d0e-8057-712cfcfa76a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.741927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0ffd7f08-74bf-4d0e-8057-712cfcfa76a3 None None] MFA Rules not processed for user `516569b70fc04dbebc4ba563acd61647`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:55.743904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0ffd7f08-74bf-4d0e-8057-712cfcfa76a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:55.795017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a00766-9f50-4f16-947c-047c28e21c7b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:55.804889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:55.806055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.807009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.807743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] PATH_INFO: `/v3/projects/2a4791bae06b40c1902093b1442c8f09/users/62de740374c74b00ba3748341ac9d181/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.839075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4791bae06b40c1902093b1442c8f09, user_id=62de740374c74b00ba3748341ac9d181, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:55.843776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:55.865090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 818/1639] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:55 2022] PUT /identity/v3/projects/2a4791bae06b40c1902093b1442c8f09/users/62de740374c74b00ba3748341ac9d181/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:55.867674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:55.894356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 822/1640] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:55.896407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a899f-98ad-40b9-93bf-177cc4ea081d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:55.897207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a899f-98ad-40b9-93bf-177cc4ea081d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:55.897584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a899f-98ad-40b9-93bf-177cc4ea081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:55.935179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-212a899f-98ad-40b9-93bf-177cc4ea081d None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:55.938386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-212a899f-98ad-40b9-93bf-177cc4ea081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:55.992041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e200f4-aa80-43d3-9ad8-fbb7379f7a14 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:56.001819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e1c1-136b-4ecd-841f-fe8f189323f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:56.002623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e1c1-136b-4ecd-841f-fe8f189323f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.003011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e1c1-136b-4ecd-841f-fe8f189323f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.003392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e1c1-136b-4ecd-841f-fe8f189323f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.076284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 823/1641] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:44:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:56.080452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310e92b-c724-44aa-b20e-5d1f71cdd39d None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.080765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310e92b-c724-44aa-b20e-5d1f71cdd39d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.081049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310e92b-c724-44aa-b20e-5d1f71cdd39d None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.084712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 824/1642] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 12 11:44:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:44:56.087117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca944b-9310-4e1c-82b9-4cd8defbbf01 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.087251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca944b-9310-4e1c-82b9-4cd8defbbf01 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.088510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca944b-9310-4e1c-82b9-4cd8defbbf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.136958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e1c1-136b-4ecd-841f-fe8f189323f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:56.139819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e1c1-136b-4ecd-841f-fe8f189323f0 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:56.156643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3fca944b-9310-4e1c-82b9-4cd8defbbf01 None None] MFA Rules not processed for user `3fc5418744ce43cf8074de1d2f0de6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:56.158622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3fca944b-9310-4e1c-82b9-4cd8defbbf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:56.158929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 819/1643] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:56.160786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dea82-b047-48d6-bb8b-521403ea9aa3 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.161301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dea82-b047-48d6-bb8b-521403ea9aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.162359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dea82-b047-48d6-bb8b-521403ea9aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.201963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-235dea82-b047-48d6-bb8b-521403ea9aa3 None None] MFA Rules not processed for user `62de740374c74b00ba3748341ac9d181`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:56.205103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-235dea82-b047-48d6-bb8b-521403ea9aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:56.297591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 825/1644] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:56.299561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca944b-9310-4e1c-82b9-4cd8defbbf01 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:56.305571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 820/1645] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:56.305571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c610c-05b6-4e9a-96d0-247179db9b5d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.305571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c610c-05b6-4e9a-96d0-247179db9b5d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.305571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c610c-05b6-4e9a-96d0-247179db9b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.315240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca944b-9310-4e1c-82b9-4cd8defbbf01 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:56.319005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:56.319662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.319944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.320220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.329872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6b5c610c-05b6-4e9a-96d0-247179db9b5d None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:56.331286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6b5c610c-05b6-4e9a-96d0-247179db9b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:56.355020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 821/1646] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:56.355886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c610c-05b6-4e9a-96d0-247179db9b5d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:56.380506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c610c-05b6-4e9a-96d0-247179db9b5d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:56.384818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdde26c-9e17-4c13-8c37-e38a4fdc6018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:56.385474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde26c-9e17-4c13-8c37-e38a4fdc6018 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.385786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde26c-9e17-4c13-8c37-e38a4fdc6018 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.386063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde26c-9e17-4c13-8c37-e38a4fdc6018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.391338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:56.393109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:56.399534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde26c-9e17-4c13-8c37-e38a4fdc6018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:56.402005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde26c-9e17-4c13-8c37-e38a4fdc6018 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:56.405825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 826/1647] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:56 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:56.406915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:56.417649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 822/1648] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:56.419905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f050c-cdcf-4473-a66f-6b44a18b558b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.420204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f050c-cdcf-4473-a66f-6b44a18b558b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.420782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f050c-cdcf-4473-a66f-6b44a18b558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.443556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ab2f050c-cdcf-4473-a66f-6b44a18b558b None None] MFA Rules not processed for user `3fc5418744ce43cf8074de1d2f0de6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:56.444415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ab2f050c-cdcf-4473-a66f-6b44a18b558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:56.463512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 823/1649] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:56.559427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64729f40-b53f-429f-b35f-cd6b1b7ffcd5 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:56.573342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:56.574062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.574492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.574779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.575489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:56.577463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:56.635038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f050c-cdcf-4473-a66f-6b44a18b558b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:56.661940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f050c-cdcf-4473-a66f-6b44a18b558b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:56.669860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 827/1650] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:44:56 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:56.671146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:56.683013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:56.684131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.686516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.686996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.715381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:56.720398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:56.750380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 824/1651] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:56.752051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:56.787961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da360-fe34-4df0-815d-f89f9a434567 service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:56.839886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36685d2e-250e-424d-b17d-b58cdbe3baf5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:56.851771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:56.852953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.853236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.854462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.946469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:56.949288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:56.949726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:56.950778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:56.952859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:56.961863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:57.026653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 825/1652] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:44:56 2022] POST /identity/v3/users => generated 295 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:44:57.030504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:57.031439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:57.033687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:57.044956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab220eca-92e1-4f60-9c16-683e22c37ccc admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:57.050505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 828/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:57.050964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:57.051652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.051982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.052332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.053182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:57.059205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:57.075415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:57.087696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 826/1654] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:57.092135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d75ef8-3ac9-4d7d-a15a-54c8ee51db1c service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:57.093867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:57.101297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:57.102100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.102389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.102667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.124161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ec268-d604-40d0-8427-9325060bbcd2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:57.144264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:57.145278 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.145562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.145868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] PATH_INFO: `/v3/projects/1afd6e2ac0f541a385284494d820652d/users/19b7d517244f4594b6c2a3eed968e8ed/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.167996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afd6e2ac0f541a385284494d820652d, user_id=19b7d517244f4594b6c2a3eed968e8ed, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:57.172493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:57.198297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 827/1655] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:57 2022] PUT /identity/v3/projects/1afd6e2ac0f541a385284494d820652d/users/19b7d517244f4594b6c2a3eed968e8ed/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:57.199319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:57.224173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:57.225966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:57.237102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 829/1656] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:44:57.354196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd515b-cb21-460a-97b1-6fdbb7764fb1 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:57.371256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839d3e2-13c4-48c3-99d7-5df43499ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:57.373502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839d3e2-13c4-48c3-99d7-5df43499ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.375719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839d3e2-13c4-48c3-99d7-5df43499ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.376827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839d3e2-13c4-48c3-99d7-5df43499ce91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.379038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839d3e2-13c4-48c3-99d7-5df43499ce91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:57.382679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839d3e2-13c4-48c3-99d7-5df43499ce91 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:57.417167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 828/1657] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:44:57.417772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:57.436272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f533-1b4d-4279-9fb4-0837903735b7 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:57.470040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f61dd-03c6-44ff-908a-2af9ad3f7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:57.470933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f61dd-03c6-44ff-908a-2af9ad3f7a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.471276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f61dd-03c6-44ff-908a-2af9ad3f7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.471986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f61dd-03c6-44ff-908a-2af9ad3f7a9d admin admin] PATH_INFO: `/v3/projects/1afd6e2ac0f541a385284494d820652d/users/19b7d517244f4594b6c2a3eed968e8ed/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.480093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f61dd-03c6-44ff-908a-2af9ad3f7a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afd6e2ac0f541a385284494d820652d, user_id=19b7d517244f4594b6c2a3eed968e8ed, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:57.482870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f61dd-03c6-44ff-908a-2af9ad3f7a9d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:57.512414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 830/1658] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:44:57 2022] PUT /identity/v3/projects/1afd6e2ac0f541a385284494d820652d/users/19b7d517244f4594b6c2a3eed968e8ed/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:44:57.524228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea988dc-6e22-4143-b322-176107df2a11 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.524520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea988dc-6e22-4143-b322-176107df2a11 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.524816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea988dc-6e22-4143-b322-176107df2a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.598001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-5ea988dc-6e22-4143-b322-176107df2a11 None None] MFA Rules not processed for user `19b7d517244f4594b6c2a3eed968e8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:57.605188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5ea988dc-6e22-4143-b322-176107df2a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:57.676464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b135c9-77ec-4443-97cd-061164860e61 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.676746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b135c9-77ec-4443-97cd-061164860e61 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.677028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b135c9-77ec-4443-97cd-061164860e61 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.678828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 831/1659] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 12 11:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:44:57.685149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed674-cb5f-4715-9612-0e0d04c864b4 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:57.685519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed674-cb5f-4715-9612-0e0d04c864b4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:57.685691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed674-cb5f-4715-9612-0e0d04c864b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:57.818781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-102ed674-cb5f-4715-9612-0e0d04c864b4 None None] MFA Rules not processed for user `9c1c4e1fe220486ab672b3dea6ffdfec`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:57.822481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-102ed674-cb5f-4715-9612-0e0d04c864b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:57.877729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 829/1660] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:57.885583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea988dc-6e22-4143-b322-176107df2a11 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:57.927388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 832/1661] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:44:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:44:57.928284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ed674-cb5f-4715-9612-0e0d04c864b4 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:58.043619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ed674-cb5f-4715-9612-0e0d04c864b4 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:58.045100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea988dc-6e22-4143-b322-176107df2a11 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:58.054679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:58.055538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:58.057011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:58.057450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:58.059519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:58.060406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:58.060692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:58.060973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] PATH_INFO: `/v3/users/5c89c3dea13a43c88d725876f67dfba2` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:58.063057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c89c3dea13a43c88d725876f67dfba2)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:58.064806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: WARNING py.warnings [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:44:58.064806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: warnings.warn(msg) May 12 11:44:58.064806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: May 12 11:44:58.066092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:58.193248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:58.194748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:58.216671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 833/1662] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:58.229442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:58.263406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47c9b-8df2-4e78-bda4-9ad4826c2bde service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:58.273300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c89c3dea13a43c88d725876f67dfba2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:58.277927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ca4e7-f07c-45f3-8a9b-67b450f7177d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:58.278603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ca4e7-f07c-45f3-8a9b-67b450f7177d service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:58.278888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ca4e7-f07c-45f3-8a9b-67b450f7177d service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:58.284111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ca4e7-f07c-45f3-8a9b-67b450f7177d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:58.306355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ca4e7-f07c-45f3-8a9b-67b450f7177d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:58.309429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ca4e7-f07c-45f3-8a9b-67b450f7177d service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:58.347929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 834/1663] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:44:58.354737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c89c3dea13a43c88d725876f67dfba2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:58.356773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c89c3dea13a43c88d725876f67dfba2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:58.399438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c89c3dea13a43c88d725876f67dfba2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:58.404975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c89c3dea13a43c88d725876f67dfba2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:58.458055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 830/1664] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:44:57 2022] DELETE /identity/v3/users/5c89c3dea13a43c88d725876f67dfba2 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:44:58.461125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:58.462100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:58.462100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:58.536159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:58.539776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:58.688047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:58.690011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:58.874207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02012fd-2e58-4048-932a-81be28794cd1 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:58.926477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:58.927374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:58.927657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:58.927931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] PATH_INFO: `/v3/users/0eaa0f64a1c24f39a8f994bdd2eeae86` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:58.943727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaa0f64a1c24f39a8f994bdd2eeae86)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:58.945963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:59.063151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaa0f64a1c24f39a8f994bdd2eeae86'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:59.085224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaa0f64a1c24f39a8f994bdd2eeae86'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:59.086356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaa0f64a1c24f39a8f994bdd2eeae86'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:59.131060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 835/1665] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 670 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:59.131694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaa0f64a1c24f39a8f994bdd2eeae86'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:59.132768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8bef2061-5f4d-411e-a18e-6afb6aead60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaa0f64a1c24f39a8f994bdd2eeae86'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:44:59.154097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:59.156475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:59.172071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 831/1666] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:44:58 2022] DELETE /identity/v3/users/0eaa0f64a1c24f39a8f994bdd2eeae86 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:44:59.181777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:59.183723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:59.184165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:59.214777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:44:59.216407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:59.327628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 832/1667] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:44:59.338103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e06821-17b4-4475-8cae-f9264a10fd86 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:59.358628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:44:59.360341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:44:59.437571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8ed6-a5d6-4cc0-8a3d-22eed06df481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:59.438791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8ed6-a5d6-4cc0-8a3d-22eed06df481 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:59.441918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8ed6-a5d6-4cc0-8a3d-22eed06df481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:59.442396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8ed6-a5d6-4cc0-8a3d-22eed06df481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:59.464873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee8ed6-a5d6-4cc0-8a3d-22eed06df481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:59.467218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee8ed6-a5d6-4cc0-8a3d-22eed06df481 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:59.472797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489e07e-1f44-4300-8411-00302fb66f00 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:44:59.479284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 836/1668] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:44:59.490570 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac51ea-995e-423e-93aa-7331c6f3f08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:44:59.493069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac51ea-995e-423e-93aa-7331c6f3f08a service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:44:59.493536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac51ea-995e-423e-93aa-7331c6f3f08a service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:44:59.493847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac51ea-995e-423e-93aa-7331c6f3f08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:44:59.514543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac51ea-995e-423e-93aa-7331c6f3f08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:44:59.516716 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac51ea-995e-423e-93aa-7331c6f3f08a service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:44:59.543943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 833/1669] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:00.111869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1124-7221-4efe-a10f-3d93ef418644 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:00.112257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1124-7221-4efe-a10f-3d93ef418644 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:00.112684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1124-7221-4efe-a10f-3d93ef418644 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:00.114494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 837/1670] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 12 11:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:45:00.130831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e726-b805-4351-8d38-d553023a5877 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:00.131121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e726-b805-4351-8d38-d553023a5877 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:00.131402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e726-b805-4351-8d38-d553023a5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:00.190787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-a701e726-b805-4351-8d38-d553023a5877 None None] MFA Rules not processed for user `aa6eb30499054f368f00f38c946d7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:00.194271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a701e726-b805-4351-8d38-d553023a5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:00.478032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 834/1671] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 12 11:45:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:00.487918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1124-7221-4efe-a10f-3d93ef418644 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:00.520096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1124-7221-4efe-a10f-3d93ef418644 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:00.540491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:00.541415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:00.542393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:00.543060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:00.549464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:00.586726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701e726-b805-4351-8d38-d553023a5877 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:00.588507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a701e726-b805-4351-8d38-d553023a5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:00.600472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:00.608364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:00.642590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 838/1672] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:00.718414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701e726-b805-4351-8d38-d553023a5877 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:00.728265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:00.729428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:00.729428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:00.731029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:00.736149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:00.816889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:00.819308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:00.846317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6ae71-49a3-4f8a-80ef-4150a6855e06 service placement] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:00.862361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:00.864024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:00.864608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:00.865605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] PATH_INFO: `/v3/projects/0c4f8e1511da40a78043126239818bb5` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:00.868801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4f8e1511da40a78043126239818bb5)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:00.870015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: WARNING py.warnings [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 11:45:00.870015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: warnings.warn(msg) May 12 11:45:00.870015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: May 12 11:45:00.877853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:00.912411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:00.916874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:00.966307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 835/1673] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:01.003036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4f8e1511da40a78043126239818bb5', 'request_id': 'req-4066a391-5221-4b68-a7d4-fd3933e15c34'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.034146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4f8e1511da40a78043126239818bb5', 'request_id': 'req-4066a391-5221-4b68-a7d4-fd3933e15c34'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.081926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4f8e1511da40a78043126239818bb5', 'request_id': 'req-4066a391-5221-4b68-a7d4-fd3933e15c34'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.118763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:01.120281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:01.122238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] The token cache is being invalidate because project 0c4f8e1511da40a78043126239818bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:01.122792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.123712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.133860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 839/1674] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:00 2022] DELETE /identity/v3/projects/0c4f8e1511da40a78043126239818bb5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:01.137561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:01.142125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:01.173072 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54c61d-6b7a-4bba-a77d-946885db02fe service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:01.316890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066a391-5221-4b68-a7d4-fd3933e15c34 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:01.340017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:01.341256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:01.341780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:01.342286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] PATH_INFO: `/v3/users/a1d84c35f15c4c2fb7ef0497e2fb3758` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:01.346534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d84c35f15c4c2fb7ef0497e2fb3758)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:01.348824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:01.435461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:01.441569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:01.441892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:01.442182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] PATH_INFO: `/v3/projects/9ac9e0f81ffb4e37a6dfa644500012a3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:01.451928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac9e0f81ffb4e37a6dfa644500012a3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:01.461294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:01.494619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d84c35f15c4c2fb7ef0497e2fb3758'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.524847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d84c35f15c4c2fb7ef0497e2fb3758'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.526439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d84c35f15c4c2fb7ef0497e2fb3758'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.564357 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d84c35f15c4c2fb7ef0497e2fb3758'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.571700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d84c35f15c4c2fb7ef0497e2fb3758'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.619309 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 840/1675] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:01 2022] DELETE /identity/v3/users/a1d84c35f15c4c2fb7ef0497e2fb3758 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:01.623783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac9e0f81ffb4e37a6dfa644500012a3', 'request_id': 'req-0d1937dd-7607-45c3-8b73-736851e2a71a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.625201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:01.635304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:01.649148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac9e0f81ffb4e37a6dfa644500012a3', 'request_id': 'req-0d1937dd-7607-45c3-8b73-736851e2a71a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.658320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac9e0f81ffb4e37a6dfa644500012a3', 'request_id': 'req-0d1937dd-7607-45c3-8b73-736851e2a71a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.698248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] The token cache is being invalidate because project 9ac9e0f81ffb4e37a6dfa644500012a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:01.698504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.704172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d1937dd-7607-45c3-8b73-736851e2a71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:01.713533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 836/1676] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:01 2022] DELETE /identity/v3/projects/9ac9e0f81ffb4e37a6dfa644500012a3 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:01.716289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2469-7a43-40cb-a3bf-cf89311858e5 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:01.716585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2469-7a43-40cb-a3bf-cf89311858e5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:01.717054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2469-7a43-40cb-a3bf-cf89311858e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:01.908193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8681721-aab9-4c4f-aea4-66f01bcbf9c5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:01.944032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:01.944910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:01.945191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:01.945469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] PATH_INFO: `/v3/users/2202a18ec7ca43719af92bacb746cd6c` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:01.947891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2202a18ec7ca43719af92bacb746cd6c)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:01.953827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:02.104414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2202a18ec7ca43719af92bacb746cd6c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:02.129142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2202a18ec7ca43719af92bacb746cd6c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:02.129896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2202a18ec7ca43719af92bacb746cd6c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:02.146043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-df7c2469-7a43-40cb-a3bf-cf89311858e5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:02.147807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-df7c2469-7a43-40cb-a3bf-cf89311858e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:02.153323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2202a18ec7ca43719af92bacb746cd6c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:02.154080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b52118b2-7219-4147-9932-08806387f585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2202a18ec7ca43719af92bacb746cd6c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:02.165075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 837/1677] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:02.174194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982061-3862-4f07-b5f3-7ebd1499daaa None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.175534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982061-3862-4f07-b5f3-7ebd1499daaa None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.177795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982061-3862-4f07-b5f3-7ebd1499daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.189270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 841/1678] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:01 2022] DELETE /identity/v3/users/2202a18ec7ca43719af92bacb746cd6c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:02.193472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.194735 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.195203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.229018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bb982061-3862-4f07-b5f3-7ebd1499daaa None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:02.231781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bb982061-3862-4f07-b5f3-7ebd1499daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:02.244359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:02.245957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:02.386853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 838/1679] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:02.393152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb982061-3862-4f07-b5f3-7ebd1499daaa None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:02.416692 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 842/1680] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:02.419475 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb982061-3862-4f07-b5f3-7ebd1499daaa None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:02.426435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:02.427831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.427831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.427831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.428554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:02.428857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:02.431382 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:02.439300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:02.440935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:02.471058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 839/1681] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:02.472461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:02.505512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eac71-4a63-4eb2-a5a4-6fd5d04351f2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:02.511643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:02.512007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.512267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.512540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.513274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:02.515413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:02.532902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fd2ee-0b4a-483b-bdc4-ad196bad10b6 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:02.537556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:02.538816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.539308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.539822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.553685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:02.555679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:02.567372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 843/1682] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:02.578225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 840/1683] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:02 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:02.582357 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:02.595441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578908b-627f-4f56-ab90-f6698d118dfc service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:02.733143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:02.734439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.734908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.735480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.738570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:02.742662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:02.818579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 844/1684] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:02 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:02.820482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:02.836899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3471e-0730-4393-a02c-cf5090de5fce admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:02.858782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:02.859530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.860012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.860294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.861036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:02.863037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:02.875566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 841/1685] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:02.879656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:02.893727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdccdf-cf82-4b99-b48f-f68a7e56e8a8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:02.901595 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb772c-3b55-4f96-8842-caffda35bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:02.902343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb772c-3b55-4f96-8842-caffda35bea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.902623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb772c-3b55-4f96-8842-caffda35bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.902904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb772c-3b55-4f96-8842-caffda35bea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.903648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb772c-3b55-4f96-8842-caffda35bea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:02.905506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb772c-3b55-4f96-8842-caffda35bea6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:02.921753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 845/1686] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:02.923873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:02.939510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c05571-bad3-4cb1-bab6-acda54056919 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:02.952098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:02.953024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:02.953315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:02.954605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] PATH_INFO: `/v3/projects/15753a2516ea48138f7fa6ae87ff81a3/users/b0eee535debb4eaf9e451d7833b2115c/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:02.973744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15753a2516ea48138f7fa6ae87ff81a3, user_id=b0eee535debb4eaf9e451d7833b2115c, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:02.976439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:03.006463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 842/1687] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:02 2022] PUT /identity/v3/projects/15753a2516ea48138f7fa6ae87ff81a3/users/b0eee535debb4eaf9e451d7833b2115c/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:03.012715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:03.014208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:03.014712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:03.062299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:03.064134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:03.274040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 846/1688] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:03.301392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:03.303913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:03.478858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784017b-9065-4439-8ed0-0563d758b695 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:03.491235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:03.491973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:03.492258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:03.492541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:03.514103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:03.518729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:03.552877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 843/1689] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:03.706561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:03.708216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:03.808933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:03.811108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:03.844249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d782f84-4ee5-4611-a077-0096dc33d1e1 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:03.858140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:03.859280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:03.860062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:03.860365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] PATH_INFO: `/v3/projects/c15aa1c247e34833b5611860bb1a95b5` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:03.869475 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15aa1c247e34833b5611860bb1a95b5)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:03.873688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:03.887910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db4955-e355-47b7-adf2-41aa063c0108 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:03.893579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da5351-a3a5-4cc2-a464-9e62530384df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:03.894315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5351-a3a5-4cc2-a464-9e62530384df service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:03.894602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5351-a3a5-4cc2-a464-9e62530384df service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:03.895543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5351-a3a5-4cc2-a464-9e62530384df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:03.900061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-12da5351-a3a5-4cc2-a464-9e62530384df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:03.995576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15aa1c247e34833b5611860bb1a95b5', 'request_id': 'req-67a60b55-99c4-4845-bbee-2a4d49168e6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.015069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da5351-a3a5-4cc2-a464-9e62530384df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:04.019885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da5351-a3a5-4cc2-a464-9e62530384df service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:04.022947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15aa1c247e34833b5611860bb1a95b5', 'request_id': 'req-67a60b55-99c4-4845-bbee-2a4d49168e6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.030458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15aa1c247e34833b5611860bb1a95b5', 'request_id': 'req-67a60b55-99c4-4845-bbee-2a4d49168e6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.039741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 847/1690] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:04.042484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523edce2-6a06-46b6-8d14-9209df23e908 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:04.043645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523edce2-6a06-46b6-8d14-9209df23e908 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:04.045244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523edce2-6a06-46b6-8d14-9209df23e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:04.055635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] The token cache is being invalidate because project c15aa1c247e34833b5611860bb1a95b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:04.055939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.060717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-67a60b55-99c4-4845-bbee-2a4d49168e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.066681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 844/1691] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:03 2022] DELETE /identity/v3/projects/c15aa1c247e34833b5611860bb1a95b5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:04.069149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:04.069149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:04.069149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:04.113412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-523edce2-6a06-46b6-8d14-9209df23e908 None None] MFA Rules not processed for user `635d1cf64110483b843b01e6e6ddc749`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:04.116420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-523edce2-6a06-46b6-8d14-9209df23e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.123494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:04.125761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.263408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 845/1692] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:04.264566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:04.269354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.281319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45800c1-8b74-48d3-a0a7-3bf7e7b22e3f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:04.288620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:04.289639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:04.292091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:04.292392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] PATH_INFO: `/v3/projects/4af23c89d27f4dd8bbd6d1f6ce716d0f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:04.294293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af23c89d27f4dd8bbd6d1f6ce716d0f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:04.298559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:04.362450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 848/1693] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:04.371209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af23c89d27f4dd8bbd6d1f6ce716d0f', 'request_id': 'req-52c3f59e-2c26-4772-863b-306abd9151df'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.377080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:04.377402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:04.377680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:04.384794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af23c89d27f4dd8bbd6d1f6ce716d0f', 'request_id': 'req-52c3f59e-2c26-4772-863b-306abd9151df'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.394101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af23c89d27f4dd8bbd6d1f6ce716d0f', 'request_id': 'req-52c3f59e-2c26-4772-863b-306abd9151df'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.423217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] The token cache is being invalidate because project 4af23c89d27f4dd8bbd6d1f6ce716d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:04.424158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.425114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.427090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 846/1694] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:04 2022] DELETE /identity/v3/projects/4af23c89d27f4dd8bbd6d1f6ce716d0f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:04.428040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:04.429924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.456991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:04.465148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.564071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f59e-2c26-4772-863b-306abd9151df admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:04.571773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:04.572794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:04.573191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:04.573577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:04.576282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.580557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 849/1695] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:04.582022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:04.584925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.616085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a1e6d-a02c-4d2f-8878-5dcb56072c74 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:04.622809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:04.627452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:04.627784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:04.628059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] PATH_INFO: `/v3/users/516569b70fc04dbebc4ba563acd61647` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:04.630164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516569b70fc04dbebc4ba563acd61647)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:04.632142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:04.704215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:04.705870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:04.721834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 847/1696] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:04.722703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:04.740301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516569b70fc04dbebc4ba563acd61647'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.755253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb58d78-af4c-4a07-8f24-4a207ffb1491 service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:04.756164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516569b70fc04dbebc4ba563acd61647'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.756851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516569b70fc04dbebc4ba563acd61647'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.762761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:04.763437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:04.763720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:04.763994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:04.764727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:04.765059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:04.767341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:04.779839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516569b70fc04dbebc4ba563acd61647'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.781281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516569b70fc04dbebc4ba563acd61647'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:04.793576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 848/1697] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:04.806758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:04.808661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:04.809490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 850/1698] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:04 2022] DELETE /identity/v3/users/516569b70fc04dbebc4ba563acd61647 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:04.842253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7bb8-f440-4665-be0c-4b4033cf9eb3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:05.016204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771389c3-cb4a-459f-a2cc-7c9413d3c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:05.018077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771389c3-cb4a-459f-a2cc-7c9413d3c51e admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.018370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771389c3-cb4a-459f-a2cc-7c9413d3c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.019713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771389c3-cb4a-459f-a2cc-7c9413d3c51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.020450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771389c3-cb4a-459f-a2cc-7c9413d3c51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:05.026207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771389c3-cb4a-459f-a2cc-7c9413d3c51e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:05.098362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 849/1699] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:04 2022] POST /identity/v3/projects => generated 357 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:05.099557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:05.113395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c4c9-ecb2-4491-a5b9-f33caa205627 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:05.147397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6ee4-bc5f-460f-87cc-cac6b38461ae None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.159169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6ee4-bc5f-460f-87cc-cac6b38461ae None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.159575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6ee4-bc5f-460f-87cc-cac6b38461ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.208294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4bca6ee4-bc5f-460f-87cc-cac6b38461ae None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:05.212689 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4bca6ee4-bc5f-460f-87cc-cac6b38461ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:05.315388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:05.316222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.316632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.317062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.317861 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:05.320732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:05.383343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 851/1700] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:05 2022] POST /identity/v3/users => generated 279 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:05.387879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:05.396355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 850/1701] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:45:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:05.423103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6ee3b-6f3a-4eef-8779-6983ce2e3a89 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:05.442753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:05.443443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.443730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.444010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.445121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:05.446435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:05.489079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 852/1702] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:05.490068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca6ee4-bc5f-460f-87cc-cac6b38461ae None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:05.509957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca6ee4-bc5f-460f-87cc-cac6b38461ae None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:05.528386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:05.530294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.530759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.532490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.534442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:05.537211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:05.588984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 851/1703] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:05.593048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:05.612366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:05.615124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0f3d-f11a-4ef1-8576-f326e7d24727 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:05.616717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:05.632667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:05.635233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.636868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.637311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] PATH_INFO: `/v3/projects/03d06270fed4485ea61225f27d0a8819/users/cffc379c42ab48fcb8d46dc770c788d5/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.676493 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d06270fed4485ea61225f27d0a8819, user_id=cffc379c42ab48fcb8d46dc770c788d5, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:05.677908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583248-2aab-40ef-b12d-4951a81e76c6 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:05.681113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:05.701240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:05.702155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.702440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.702717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] PATH_INFO: `/v3/projects/743147086cf04a5d8239a33de5269ede` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.705379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743147086cf04a5d8239a33de5269ede)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:05.705788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 853/1704] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:05 2022] PUT /identity/v3/projects/03d06270fed4485ea61225f27d0a8819/users/cffc379c42ab48fcb8d46dc770c788d5/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:05.707106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:05.711860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:05.715115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:05.850763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743147086cf04a5d8239a33de5269ede', 'request_id': 'req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:05.865535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce85e-89dc-4c89-9c47-3cdffc563bac admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:05.876535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743147086cf04a5d8239a33de5269ede', 'request_id': 'req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:05.886199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743147086cf04a5d8239a33de5269ede', 'request_id': 'req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:05.915293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] The token cache is being invalidate because project 743147086cf04a5d8239a33de5269ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:05.915912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:05.919940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c05cc8b8-c975-42ca-b16d-bb2c23d6e150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:05.922603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 852/1705] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:05 2022] DELETE /identity/v3/projects/743147086cf04a5d8239a33de5269ede => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:05.924075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aac04-10ce-4b07-9636-0031384af6dc None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:05.924597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aac04-10ce-4b07-9636-0031384af6dc None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:05.926111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aac04-10ce-4b07-9636-0031384af6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:05.995329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ea6aac04-10ce-4b07-9636-0031384af6dc None None] MFA Rules not processed for user `cffc379c42ab48fcb8d46dc770c788d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:05.998517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ea6aac04-10ce-4b07-9636-0031384af6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:06.026120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:06.026917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:06.027304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:06.027682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:06.032441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:06.188834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:06.193328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 853/1706] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:06.193328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e983ac4-d0b8-41f3-aee1-e850c8c35daf None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:06.193922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:06.195689 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e983ac4-d0b8-41f3-aee1-e850c8c35daf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:06.196188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e983ac4-d0b8-41f3-aee1-e850c8c35daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:06.212175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 854/1707] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:45:06.213010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:06.217559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:06.231070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6e983ac4-d0b8-41f3-aee1-e850c8c35daf None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:06.232275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6e983ac4-d0b8-41f3-aee1-e850c8c35daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:06.355296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69e55-bc13-4e91-8d84-5e1d4a95da9e service swift] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:06.371608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:06.372218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:06.372498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:06.372776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:06.373479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:06.375623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:06.414969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 854/1708] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:06.422400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:06.423218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:06.424410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:06.466598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 855/1709] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:06 2022] POST /identity/v3/projects => generated 357 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:06.470622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:06.520635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:06.531463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:06.844852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961dcf-0f14-4ddc-b18d-2d5519857b6e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:06.868219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 855/1710] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:06.869605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:06.871975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a88e5-56ed-4ef6-b2d6-0fc505486a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:06.872572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:06.873646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a88e5-56ed-4ef6-b2d6-0fc505486a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:06.885922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a88e5-56ed-4ef6-b2d6-0fc505486a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:06.885922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a88e5-56ed-4ef6-b2d6-0fc505486a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:06.885922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a88e5-56ed-4ef6-b2d6-0fc505486a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:06.885922 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a88e5-56ed-4ef6-b2d6-0fc505486a0e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:06.923302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da163f-6248-4a40-b313-78f5eef23162 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:06.940734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 856/1711] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:06 2022] POST /identity/v3/users => generated 285 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:06.944566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45819d4c-0eb8-4656-8e99-32a612459bce None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:06.945084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45819d4c-0eb8-4656-8e99-32a612459bce None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:06.945541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45819d4c-0eb8-4656-8e99-32a612459bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:06.956289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:06.957188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:06.957478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:06.957831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] PATH_INFO: `/v3/users/5dd78ec10aaf4031968c876c876f489d` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:06.963787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd78ec10aaf4031968c876c876f489d)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:06.965804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:07.009303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-45819d4c-0eb8-4656-8e99-32a612459bce None None] MFA Rules not processed for user `b0eee535debb4eaf9e451d7833b2115c`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:07.012643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-45819d4c-0eb8-4656-8e99-32a612459bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:07.189479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 857/1712] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:07.207444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45819d4c-0eb8-4656-8e99-32a612459bce None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:07.222279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd78ec10aaf4031968c876c876f489d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:07.249250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45819d4c-0eb8-4656-8e99-32a612459bce None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:07.254723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd78ec10aaf4031968c876c876f489d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:07.259495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd78ec10aaf4031968c876c876f489d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:07.267733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:07.275174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:07.275484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:07.275751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:07.276521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:07.276890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:07.310300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:07.364852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd78ec10aaf4031968c876c876f489d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:07.367739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd78ec10aaf4031968c876c876f489d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:07.399582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 858/1713] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:07.401520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:07.415057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:07.415530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 856/1714] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:06 2022] DELETE /identity/v3/users/5dd78ec10aaf4031968c876c876f489d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:07.417649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:07.421871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:07.460575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa16dc7-29e4-4128-b1e1-6989b842d286 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:07.676671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ec42-f25c-4ef1-b8bf-e1194d92fc44 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:07.686280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:07.699834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8c88a-5271-4753-9322-59f3f2ca84e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:07.701688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c88a-5271-4753-9322-59f3f2ca84e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:07.703640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c88a-5271-4753-9322-59f3f2ca84e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:07.704726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:07.705319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:07.705426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c88a-5271-4753-9322-59f3f2ca84e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:07.706056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:07.707498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8c88a-5271-4753-9322-59f3f2ca84e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:07.708808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:07.719266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8c88a-5271-4753-9322-59f3f2ca84e3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:07.723605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:07.800183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 857/1715] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:07 2022] POST /identity/v3/projects => generated 405 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:07.802722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:07.809851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 859/1716] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:07.812635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:07.817970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0810-72f9-40a4-a332-e66083d61828 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:07.820267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0810-72f9-40a4-a332-e66083d61828 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:07.820560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0810-72f9-40a4-a332-e66083d61828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:07.905195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2d2d0810-72f9-40a4-a332-e66083d61828 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:07.911786 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2d2d0810-72f9-40a4-a332-e66083d61828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:08.016239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4630df-d3fd-45f3-92e0-7f9dc8ee27c6 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:08.043411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:08.045920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:08.051141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:08.051958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:08.053908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:08.056739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:08.150069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 858/1717] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:07 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:08.152179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:08.243219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 860/1718] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:08.244654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0810-72f9-40a4-a332-e66083d61828 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:08.290307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0810-72f9-40a4-a332-e66083d61828 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:08.425156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e5c0-e1ab-4e07-a95b-20f3464a3f11 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:08.440281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:08.442075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:08.442594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:08.443192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:08.444952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:08.447162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:08.534544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:08.534544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:08.534544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:08.534544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] PATH_INFO: `/v3/projects/32aafb6ad99e452cadc80cc2b78f01f5/users/71a344464c794d509407958525061059/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:08.546126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 859/1719] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:08 2022] POST /identity/v3/users => generated 309 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:08.560885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:08.581479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32aafb6ad99e452cadc80cc2b78f01f5, user_id=71a344464c794d509407958525061059, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:08.589583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:08.622832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b7950-e5b5-4e52-b7d6-e3da4969c908 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:08.638333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 861/1720] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:08 2022] PUT /identity/v3/projects/32aafb6ad99e452cadc80cc2b78f01f5/users/71a344464c794d509407958525061059/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:08.639694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:08.645666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:08.824743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302dfa-267a-4aae-9b8b-5110db235c52 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:08.842649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:08.845334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:08.845631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:08.849998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:08.891384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:08.897194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:08.897599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:08.900905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:08.904408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:08.907791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:08.982032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 860/1721] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:08 2022] POST /identity/v3/users => generated 294 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:08.983008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.008877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcacb97-7183-4fee-a632-1f6b71426183 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.022864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.023587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.023950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.024300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.025169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.026972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.057518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 861/1722] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:09.060866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.082787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.083260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ed6a-108c-4bc3-8b21-f7a8ea9cd2b8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.087670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.102053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd6b8b-d3d5-4995-ba66-0931a1687bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.102931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd6b8b-d3d5-4995-ba66-0931a1687bad admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.103373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd6b8b-d3d5-4995-ba66-0931a1687bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.103809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd6b8b-d3d5-4995-ba66-0931a1687bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.105023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd6b8b-d3d5-4995-ba66-0931a1687bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.106834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd6b8b-d3d5-4995-ba66-0931a1687bad admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.123399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 862/1723] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:09.124628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.140859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 862/1724] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:09.144620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5560-b561-49d6-a0d6-391369cc757a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.144930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5560-b561-49d6-a0d6-391369cc757a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.145221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5560-b561-49d6-a0d6-391369cc757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.158133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c5bf-b9f4-46de-a17d-1bda175291c7 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.186328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-cdab5560-b561-49d6-a0d6-391369cc757a None None] MFA Rules not processed for user `9c1c4e1fe220486ab672b3dea6ffdfec`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:09.189974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-cdab5560-b561-49d6-a0d6-391369cc757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:09.198591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.199283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.199565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.199840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.200572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.208701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 863/1725] 10.222.0.35 () {58 vars in 1015 bytes} [Thu May 12 11:45:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:09.213801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5560-b561-49d6-a0d6-391369cc757a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.215633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.247810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 863/1726] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:09.249690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.252451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5560-b561-49d6-a0d6-391369cc757a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.264878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.266644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.267089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.267518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] PATH_INFO: `/v3/projects/fc65b9e9da164ab18dd3d095d45961a3/users/3b86410214454209a67fffc949c3b5fc/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.286105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c790a2-0f9d-45b0-920f-b9cfc4279d29 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.310299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc65b9e9da164ab18dd3d095d45961a3, user_id=3b86410214454209a67fffc949c3b5fc, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.315879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.316125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.316125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.316125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.316125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] PATH_INFO: `/v3/projects/32aafb6ad99e452cadc80cc2b78f01f5/users/71a344464c794d509407958525061059/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.323052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32aafb6ad99e452cadc80cc2b78f01f5, user_id=71a344464c794d509407958525061059, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.330391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.332644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 864/1727] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:09 2022] PUT /identity/v3/projects/fc65b9e9da164ab18dd3d095d45961a3/users/3b86410214454209a67fffc949c3b5fc/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:09.333835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.374522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 864/1728] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:09 2022] PUT /identity/v3/projects/32aafb6ad99e452cadc80cc2b78f01f5/users/71a344464c794d509407958525061059/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:09.376182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.387221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:09.461956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679b07-b2d9-410e-870e-12f4742aa295 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.554527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.555871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.556357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.557423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.558410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.561394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.588908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 865/1729] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:09.589340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30812ab-e94d-4794-8bee-fbf67d3c2546 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.594827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.609046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07316132-0d67-44c2-bf26-403b289cefd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.610126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316132-0d67-44c2-bf26-403b289cefd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.610564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316132-0d67-44c2-bf26-403b289cefd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.610983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316132-0d67-44c2-bf26-403b289cefd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.629840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07316132-0d67-44c2-bf26-403b289cefd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.630597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8d7f-3684-4c34-92be-bd7a5066f14a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.631311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07316132-0d67-44c2-bf26-403b289cefd4 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.653495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.654502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.654719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.655001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.658063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.658856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.672523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 865/1730] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:09.673730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27790d-35aa-465c-a753-9852ef50e3ae None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.679101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27790d-35aa-465c-a753-9852ef50e3ae None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.679394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27790d-35aa-465c-a753-9852ef50e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.704126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 866/1731] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:09.707617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.745510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408645-9205-4c29-8bf0-92ba513b4935 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:09.762053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:09.762967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:09.763254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:09.763557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] PATH_INFO: `/v3/projects/5cc910c8e0744e759d5dd29555d99471/users/f03320af37ee4129a7e432256233fa1f/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:09.787023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ba27790d-35aa-465c-a753-9852ef50e3ae None None] MFA Rules not processed for user `71a344464c794d509407958525061059`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:09.788256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ba27790d-35aa-465c-a753-9852ef50e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:09.828625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc910c8e0744e759d5dd29555d99471, user_id=f03320af37ee4129a7e432256233fa1f, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:09.838767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:09.876850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 867/1732] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:09 2022] PUT /identity/v3/projects/5cc910c8e0744e759d5dd29555d99471/users/f03320af37ee4129a7e432256233fa1f/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:09.879291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.891578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:09.931667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 866/1733] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:09 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:09.932805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27790d-35aa-465c-a753-9852ef50e3ae None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:09.945537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27790d-35aa-465c-a753-9852ef50e3ae None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:10.034892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db5258-4a96-4763-a039-340c64f6f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:10.040172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5258-4a96-4763-a039-340c64f6f426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:10.046518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5258-4a96-4763-a039-340c64f6f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:10.047100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5258-4a96-4763-a039-340c64f6f426 admin admin] PATH_INFO: `/v3/projects/fc65b9e9da164ab18dd3d095d45961a3/users/3b86410214454209a67fffc949c3b5fc/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:10.056556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db5258-4a96-4763-a039-340c64f6f426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc65b9e9da164ab18dd3d095d45961a3, user_id=3b86410214454209a67fffc949c3b5fc, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:10.086463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db5258-4a96-4763-a039-340c64f6f426 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:10.150343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f74d3-3cca-4561-b5d6-ca7d2108d035 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:10.152349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 867/1734] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:09 2022] PUT /identity/v3/projects/fc65b9e9da164ab18dd3d095d45961a3/users/3b86410214454209a67fffc949c3b5fc/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:10.154916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:10.155210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:10.157025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:10.243274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] MFA Rules not processed for user `f03320af37ee4129a7e432256233fa1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:10.245002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:10.380902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:10.381939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:10.382224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:10.382501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] PATH_INFO: `/v3/users/fc1e5d1ec35744a9a489ae26e631c65b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:10.383783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1e5d1ec35744a9a489ae26e631c65b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:10.386160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:10.438316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 868/1735] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:10.438970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:10.448347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:10.495323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1e5d1ec35744a9a489ae26e631c65b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:10.524165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1e5d1ec35744a9a489ae26e631c65b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:10.525007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1e5d1ec35744a9a489ae26e631c65b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:10.554014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1e5d1ec35744a9a489ae26e631c65b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:10.557003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3fefba5e-28d1-4f3a-b4fe-865a0aabe0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1e5d1ec35744a9a489ae26e631c65b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:10.586840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 868/1736] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:09 2022] DELETE /identity/v3/users/fc1e5d1ec35744a9a489ae26e631c65b => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:10.586840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb01ff-2f00-4c20-a466-43d5c442065f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:10.586840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb01ff-2f00-4c20-a466-43d5c442065f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:10.586840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb01ff-2f00-4c20-a466-43d5c442065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:10.599148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2009f0-02cb-4e48-9d7d-993f5ec10b65 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:10.678704 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-24fb01ff-2f00-4c20-a466-43d5c442065f None None] MFA Rules not processed for user `af0e1282e6024c9c8f128a8d7b235733`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:10.679144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:10.679933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-24fb01ff-2f00-4c20-a466-43d5c442065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:10.680314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:10.680793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:10.681302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:10.684680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:10.802366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:10.808431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:10.836674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 869/1737] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:10.838018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:10.842634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:10.946478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 869/1738] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:10.953582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264a07-8f95-4391-a3cd-27ae161300cc None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:10.961582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264a07-8f95-4391-a3cd-27ae161300cc None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:10.964659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264a07-8f95-4391-a3cd-27ae161300cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:11.058940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-cf264a07-8f95-4391-a3cd-27ae161300cc None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:11.060219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-cf264a07-8f95-4391-a3cd-27ae161300cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:11.090435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80d1c-f24f-4b1f-801a-6e7e5640e0eb service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:11.102249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:11.103697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:11.104131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:11.104524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:11.105479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:11.107777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:11.116747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 870/1739] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:11.118634 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae07f4-043a-460f-8789-cfac7f33c442 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:11.119497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae07f4-043a-460f-8789-cfac7f33c442 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:11.120007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae07f4-043a-460f-8789-cfac7f33c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:11.166418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 870/1740] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:10 2022] POST /identity/v3/projects => generated 387 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:11.167297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:11.175366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:11.176629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-dbae07f4-043a-460f-8789-cfac7f33c442 None None] MFA Rules not processed for user `af0e1282e6024c9c8f128a8d7b235733`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:11.179345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dbae07f4-043a-460f-8789-cfac7f33c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:11.339904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6edff-54fc-420b-ba3c-dec306bde024 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:11.349145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:11.350003 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:11.350408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:11.350791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:11.360199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:11.372259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 871/1741] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:11.373258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae07f4-043a-460f-8789-cfac7f33c442 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:11.551201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:11.553419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:11.598713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 871/1742] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:11.601605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:11.605163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:11.632369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae07f4-043a-460f-8789-cfac7f33c442 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:11.643896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:11.646079 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:11.646381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:11.646661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:11.647376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:11.649342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:11.698246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 872/1743] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:11 2022] POST /identity/v3/users => generated 300 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:11.710742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:11.723312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:11.787778 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638868-8f58-460b-b1d8-b353f52c8825 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:11.792414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:11.793126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:11.793411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:11.793901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:11.806801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:11.809433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:11.823448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 872/1744] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:11.824621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:11.826609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:11.846073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9aa68-29e1-44e8-8d75-c0b07508f950 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:11.875416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:11.877873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:11.879162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:11.879654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] PATH_INFO: `/v3/projects/4cf6ee1140af40858f19f644ca836290` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:11.882374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf6ee1140af40858f19f644ca836290)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:11.889105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:11.957349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf30e5-b06c-4c1d-9046-2fe8067a7a68 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:11.991027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf6ee1140af40858f19f644ca836290', 'request_id': 'req-61b57265-7bf1-47a1-bfc7-a0a6c3765320'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:12.002247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf6ee1140af40858f19f644ca836290', 'request_id': 'req-61b57265-7bf1-47a1-bfc7-a0a6c3765320'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:12.006016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee00f85-7184-46d5-83fe-7a563dd7c251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:12.007034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00f85-7184-46d5-83fe-7a563dd7c251 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.011146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00f85-7184-46d5-83fe-7a563dd7c251 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.012082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf6ee1140af40858f19f644ca836290', 'request_id': 'req-61b57265-7bf1-47a1-bfc7-a0a6c3765320'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:12.012530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00f85-7184-46d5-83fe-7a563dd7c251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.026320 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] The token cache is being invalidate because project 4cf6ee1140af40858f19f644ca836290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:12.027018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:12.027897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:12.033819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 873/1745] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:11 2022] DELETE /identity/v3/projects/4cf6ee1140af40858f19f644ca836290 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:12.036373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:12.036632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee00f85-7184-46d5-83fe-7a563dd7c251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:12.038604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:12.039330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee00f85-7184-46d5-83fe-7a563dd7c251 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:12.074605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 873/1746] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:12.079780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea6bd-abed-4eee-8fb3-89ccca422414 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.080245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea6bd-abed-4eee-8fb3-89ccca422414 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.080686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea6bd-abed-4eee-8fb3-89ccca422414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.138361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b57265-7bf1-47a1-bfc7-a0a6c3765320 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:12.145313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6abea6bd-abed-4eee-8fb3-89ccca422414 None None] MFA Rules not processed for user `635d1cf64110483b843b01e6e6ddc749`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:12.145671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8cfc8-ffcd-4515-bc19-a7b55d06dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:12.146561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8cfc8-ffcd-4515-bc19-a7b55d06dba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.146907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8cfc8-ffcd-4515-bc19-a7b55d06dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.147453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6abea6bd-abed-4eee-8fb3-89ccca422414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:12.147568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8cfc8-ffcd-4515-bc19-a7b55d06dba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.148388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8cfc8-ffcd-4515-bc19-a7b55d06dba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:12.153751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8cfc8-ffcd-4515-bc19-a7b55d06dba6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:12.175496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 874/1747] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:12.175496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831856d3-020a-48dc-b8fb-0936f6e83a83 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.175496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831856d3-020a-48dc-b8fb-0936f6e83a83 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.175496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831856d3-020a-48dc-b8fb-0936f6e83a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.235736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-831856d3-020a-48dc-b8fb-0936f6e83a83 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:12.242943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-831856d3-020a-48dc-b8fb-0936f6e83a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:12.279210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 875/1748] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:12.282532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 874/1749] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:12.291582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98ace-4b30-460f-b5ee-9c757f785684 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.295419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98ace-4b30-460f-b5ee-9c757f785684 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.295907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98ace-4b30-460f-b5ee-9c757f785684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.300131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831856d3-020a-48dc-b8fb-0936f6e83a83 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:12.334031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831856d3-020a-48dc-b8fb-0936f6e83a83 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:12.347025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:12.350115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.350961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.351937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] PATH_INFO: `/v3/projects/354154c7306a4d04917eaced20536ede/users/9e1be53875254c65bb3b07f26f3a1639/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.373318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-96f98ace-4b30-460f-b5ee-9c757f785684 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:12.374636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-96f98ace-4b30-460f-b5ee-9c757f785684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:12.392049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354154c7306a4d04917eaced20536ede, user_id=9e1be53875254c65bb3b07f26f3a1639, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:12.396169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:12.416684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 875/1750] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:12.428386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 876/1751] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:12 2022] PUT /identity/v3/projects/354154c7306a4d04917eaced20536ede/users/9e1be53875254c65bb3b07f26f3a1639/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:12.436482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:12.436666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f98ace-4b30-460f-b5ee-9c757f785684 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:12.477002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f98ace-4b30-460f-b5ee-9c757f785684 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:12.597493 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af93a-6713-4923-8465-fd2706c90776 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:12.609979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:12.612132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.613335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.613989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.615642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:12.619114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:12.643533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 877/1752] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:12.643721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:12.643721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.643721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.644952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:12.645259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.646202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:12.648264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:12.652145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:12.670235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36e41-c5f4-4ffa-ab29-b6fed8f419a0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:12.683714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a705b0a-3c47-4e19-bea8-7a2c73f9e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:12.695613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 876/1753] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:12.696829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:12.698136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705b0a-3c47-4e19-bea8-7a2c73f9e24a admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.700662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705b0a-3c47-4e19-bea8-7a2c73f9e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.701855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705b0a-3c47-4e19-bea8-7a2c73f9e24a admin admin] PATH_INFO: `/v3/projects/354154c7306a4d04917eaced20536ede/users/9e1be53875254c65bb3b07f26f3a1639/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.712537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a705b0a-3c47-4e19-bea8-7a2c73f9e24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=354154c7306a4d04917eaced20536ede, user_id=9e1be53875254c65bb3b07f26f3a1639, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:12.722648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a705b0a-3c47-4e19-bea8-7a2c73f9e24a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:12.729538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ed761-0de4-4466-ae56-e8b524f7a087 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:12.738460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:12.740316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.740316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.740587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.745500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:12.746946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:12.758332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 878/1754] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:12 2022] PUT /identity/v3/projects/354154c7306a4d04917eaced20536ede/users/9e1be53875254c65bb3b07f26f3a1639/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:12.760160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:12.760448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:12.760756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:12.816641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 877/1755] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:12 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:12.817485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:12.823802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] MFA Rules not processed for user `9e1be53875254c65bb3b07f26f3a1639`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:12.827077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:13.002159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfb56f-b2d6-4e8f-92c6-5acf3dde39cb admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:13.017794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:13.019738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.019960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.020982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.023520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:13.027868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:13.044457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 879/1756] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:13.056661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:13.058349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:13.078804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 878/1757] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:12 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:13.083536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:13.116677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de14b4a-92e6-4084-bab7-8f61b6c5c5b3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:13.135437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:13.136211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.136568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.139819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.144638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:13.150380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:13.192612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 879/1758] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:13.197788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:13.238333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a2a59-8d18-43b0-98d0-2d5de52051c8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:13.252268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:13.260860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.261038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e58cb-cee8-462f-b557-529440d198d6 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:13.261492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.261492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.264533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:13.273822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:13.278324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:13.278553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.278834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.279096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.306542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:13.310646 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 880/1759] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:13.310829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:13.311866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:13.332732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 880/1760] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:13.337759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27870-7b6a-46b2-bda4-bd18913c090e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:13.349985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba5542-42cc-4a66-a168-f4163ab8fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:13.350925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5542-42cc-4a66-a168-f4163ab8fea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.351211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5542-42cc-4a66-a168-f4163ab8fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.351490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5542-42cc-4a66-a168-f4163ab8fea4 admin admin] PATH_INFO: `/v3/projects/761b150df54d48fe8b96f7233cecaab7/users/820d770cf9af470ca064f25c9a96b523/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.410132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:13.416522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba5542-42cc-4a66-a168-f4163ab8fea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761b150df54d48fe8b96f7233cecaab7, user_id=820d770cf9af470ca064f25c9a96b523, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:13.421503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba5542-42cc-4a66-a168-f4163ab8fea4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:13.437560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33affe76-fc81-4979-b773-c076047c2354 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:13.457453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:13.458382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.458667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.458941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] PATH_INFO: `/v3/users/f03320af37ee4129a7e432256233fa1f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.460230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03320af37ee4129a7e432256233fa1f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:13.466585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:13.477070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 881/1761] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:13 2022] PUT /identity/v3/projects/761b150df54d48fe8b96f7233cecaab7/users/820d770cf9af470ca064f25c9a96b523/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:13.479199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b8723-adbb-4e09-9965-6ccd9814e8fe None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.479502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b8723-adbb-4e09-9965-6ccd9814e8fe None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.480177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b8723-adbb-4e09-9965-6ccd9814e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.513970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ec1b8723-adbb-4e09-9965-6ccd9814e8fe None None] MFA Rules not processed for user `820d770cf9af470ca064f25c9a96b523`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:13.515784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ec1b8723-adbb-4e09-9965-6ccd9814e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:13.608625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 882/1762] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:13.621930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b8723-adbb-4e09-9965-6ccd9814e8fe None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:13.627933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03320af37ee4129a7e432256233fa1f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:13.639179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03320af37ee4129a7e432256233fa1f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:13.639932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03320af37ee4129a7e432256233fa1f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:13.661819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03320af37ee4129a7e432256233fa1f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:13.662534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa2c10f9-510c-4b4a-a55a-f4a146f8d404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03320af37ee4129a7e432256233fa1f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:13.692509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 881/1763] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:13 2022] DELETE /identity/v3/users/f03320af37ee4129a7e432256233fa1f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:13.697985 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9ed2-7cd8-4958-a6f1-7d3e3eb88414 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.698297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9ed2-7cd8-4958-a6f1-7d3e3eb88414 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.698613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9ed2-7cd8-4958-a6f1-7d3e3eb88414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.747437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c3fa9ed2-7cd8-4958-a6f1-7d3e3eb88414 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:13.753526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c3fa9ed2-7cd8-4958-a6f1-7d3e3eb88414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:13.790597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b8723-adbb-4e09-9965-6ccd9814e8fe None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:13.877654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 882/1764] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:13.879425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba36fa-1d5b-41de-ae15-d11957ac8be3 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.880911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba36fa-1d5b-41de-ae15-d11957ac8be3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.881412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba36fa-1d5b-41de-ae15-d11957ac8be3 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.886571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 883/1765] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 12 11:45:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:45:13.899192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504757d3-e034-450f-a82d-55325c6d230d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.899496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504757d3-e034-450f-a82d-55325c6d230d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.899823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504757d3-e034-450f-a82d-55325c6d230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.924857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:13.925411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-504757d3-e034-450f-a82d-55325c6d230d None None] MFA Rules not processed for user `9c1c4e1fe220486ab672b3dea6ffdfec`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:13.925529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:13.925912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:13.926109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:13.927676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-504757d3-e034-450f-a82d-55325c6d230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:13.931973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:13.991717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 884/1766] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:13.992606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504757d3-e034-450f-a82d-55325c6d230d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:13.994026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-504757d3-e034-450f-a82d-55325c6d230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:14.017008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504757d3-e034-450f-a82d-55325c6d230d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:14.022072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:14.022890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:14.023322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:14.023604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:14.034496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:14.036290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:14.049431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 885/1767] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:14.050562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:14.060435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911903-afe5-46b8-af99-509396c4dd54 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:14.065159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:14.065775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:14.065936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:14.066132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:14.066402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:14.069069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:14.074979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:14.077078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:14.086702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 886/1768] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:14.129176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 883/1769] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:14.444891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:14.445920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:14.509726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b08423-4cf9-4a35-a2c6-7fe68737b1b5 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:14.528061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:14.528894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:14.529193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:14.529453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] PATH_INFO: `/v3/projects/db981c9e8c1e4596bda2649d950ff66e` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:14.537380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db981c9e8c1e4596bda2649d950ff66e)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:14.541614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:14.722218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db981c9e8c1e4596bda2649d950ff66e', 'request_id': 'req-287765e4-a22e-46e4-a0f3-57ea4ab80b19'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:14.756526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db981c9e8c1e4596bda2649d950ff66e', 'request_id': 'req-287765e4-a22e-46e4-a0f3-57ea4ab80b19'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:14.771397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db981c9e8c1e4596bda2649d950ff66e', 'request_id': 'req-287765e4-a22e-46e4-a0f3-57ea4ab80b19'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:14.800543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] The token cache is being invalidate because project db981c9e8c1e4596bda2649d950ff66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:14.801025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:14.803047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-287765e4-a22e-46e4-a0f3-57ea4ab80b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:14.812655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 887/1770] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:14 2022] DELETE /identity/v3/projects/db981c9e8c1e4596bda2649d950ff66e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:14.816344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:14.836800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe6fb-ab6f-4808-aeb7-dbb500aa3b21 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:14.917570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e16e5-ef21-4306-b8c9-7000d406302e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:14.917911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e16e5-ef21-4306-b8c9-7000d406302e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:14.918224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e16e5-ef21-4306-b8c9-7000d406302e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:14.960797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-4f4e16e5-ef21-4306-b8c9-7000d406302e None None] MFA Rules not processed for user `3b86410214454209a67fffc949c3b5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:14.962835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4f4e16e5-ef21-4306-b8c9-7000d406302e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:15.064269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 888/1771] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:15.089996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:15.090988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:15.091471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:15.091823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] PATH_INFO: `/v3/users/62de740374c74b00ba3748341ac9d181` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:15.094091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62de740374c74b00ba3748341ac9d181)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:15.101833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:15.208598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62de740374c74b00ba3748341ac9d181'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:15.226083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62de740374c74b00ba3748341ac9d181'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:15.228272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62de740374c74b00ba3748341ac9d181'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:15.267261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62de740374c74b00ba3748341ac9d181'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:15.269585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3817279c-2f30-4bdf-9092-97d9e86cba6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62de740374c74b00ba3748341ac9d181'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:15.300789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 884/1772] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:14 2022] DELETE /identity/v3/users/62de740374c74b00ba3748341ac9d181 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:15.447522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8459653-4e05-415d-a641-0ff5f4b6bab1 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:15.448093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8459653-4e05-415d-a641-0ff5f4b6bab1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:15.448170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8459653-4e05-415d-a641-0ff5f4b6bab1 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:15.456978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 889/1773] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:45:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:45:15.497120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b4e9-728b-4df9-b29a-17bfd6b2a717 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:15.504492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b4e9-728b-4df9-b29a-17bfd6b2a717 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:15.504578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b4e9-728b-4df9-b29a-17bfd6b2a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:15.545977 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b887b4e9-728b-4df9-b29a-17bfd6b2a717 None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:15.551219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b887b4e9-728b-4df9-b29a-17bfd6b2a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:15.654823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8459653-4e05-415d-a641-0ff5f4b6bab1 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:15.657395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a8459653-4e05-415d-a641-0ff5f4b6bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:15.819285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 885/1774] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:45:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:15.862126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8459653-4e05-415d-a641-0ff5f4b6bab1 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:15.874394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:15.875288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:15.875573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:15.875963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] PATH_INFO: `/v3/projects/5cc910c8e0744e759d5dd29555d99471` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:15.877217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc910c8e0744e759d5dd29555d99471)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:15.880215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:15.992729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc910c8e0744e759d5dd29555d99471', 'request_id': 'req-527c7517-5f81-44da-a0f9-89e34770c41f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.026153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc910c8e0744e759d5dd29555d99471', 'request_id': 'req-527c7517-5f81-44da-a0f9-89e34770c41f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.054653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc910c8e0744e759d5dd29555d99471', 'request_id': 'req-527c7517-5f81-44da-a0f9-89e34770c41f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.092888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] The token cache is being invalidate because project 5cc910c8e0744e759d5dd29555d99471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:16.105205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.106288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.120028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 890/1775] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:15 2022] DELETE /identity/v3/projects/5cc910c8e0744e759d5dd29555d99471 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:16.123123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887b4e9-728b-4df9-b29a-17bfd6b2a717 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:16.141775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887b4e9-728b-4df9-b29a-17bfd6b2a717 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:16.316521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:16.319562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:16.320580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:16.321561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] PATH_INFO: `/v3/users/9e1be53875254c65bb3b07f26f3a1639` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:16.324935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1be53875254c65bb3b07f26f3a1639)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:16.329756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:16.451835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1be53875254c65bb3b07f26f3a1639'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.477033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1be53875254c65bb3b07f26f3a1639'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.480631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1be53875254c65bb3b07f26f3a1639'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.538722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1be53875254c65bb3b07f26f3a1639'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.540354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1be53875254c65bb3b07f26f3a1639'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:16.571764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 886/1776] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:16 2022] DELETE /identity/v3/users/9e1be53875254c65bb3b07f26f3a1639 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:16.617732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:16.617732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:16.763887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:16.766801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:16.882534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c7517-5f81-44da-a0f9-89e34770c41f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:17.067957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c7adc-d89b-461d-9554-02970e1c661e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:17.076183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:17.077314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:17.077632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:17.078867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] PATH_INFO: `/v3/projects/2a4791bae06b40c1902093b1442c8f09` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:17.080191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4791bae06b40c1902093b1442c8f09)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:17.082546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:17.188260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08968e3-9d3b-4a57-a6cd-3e953054c7db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:17.191737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08968e3-9d3b-4a57-a6cd-3e953054c7db service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:17.192025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08968e3-9d3b-4a57-a6cd-3e953054c7db service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:17.199179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08968e3-9d3b-4a57-a6cd-3e953054c7db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:17.205353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a08968e3-9d3b-4a57-a6cd-3e953054c7db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:17.210146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4791bae06b40c1902093b1442c8f09', 'request_id': 'req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.238836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4791bae06b40c1902093b1442c8f09', 'request_id': 'req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.248557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4791bae06b40c1902093b1442c8f09', 'request_id': 'req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.262158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] The token cache is being invalidate because project 2a4791bae06b40c1902093b1442c8f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:17.262795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.263642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.274529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08968e3-9d3b-4a57-a6cd-3e953054c7db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:17.278651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08968e3-9d3b-4a57-a6cd-3e953054c7db service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:17.288027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 887/1777] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:16 2022] DELETE /identity/v3/projects/2a4791bae06b40c1902093b1442c8f09 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:17.292686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:17.297446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:17.301961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 891/1778] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:17.444395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2b275-73f0-4fda-8885-6862c65c5b24 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:17.444899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2b275-73f0-4fda-8885-6862c65c5b24 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:17.445354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2b275-73f0-4fda-8885-6862c65c5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:17.528473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c0c2b275-73f0-4fda-8885-6862c65c5b24 None None] MFA Rules not processed for user `af0e1282e6024c9c8f128a8d7b235733`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:17.530751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c0c2b275-73f0-4fda-8885-6862c65c5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:17.628810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9db4dc-acd4-4fda-ae00-7adeffe82c02 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:17.653912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:17.659705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:17.660804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:17.662038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] PATH_INFO: `/v3/users/19b7d517244f4594b6c2a3eed968e8ed` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:17.665050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b7d517244f4594b6c2a3eed968e8ed)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:17.668863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:17.756797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b7d517244f4594b6c2a3eed968e8ed'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.766700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b7d517244f4594b6c2a3eed968e8ed'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.767500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b7d517244f4594b6c2a3eed968e8ed'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.791851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b7d517244f4594b6c2a3eed968e8ed'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.792974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b7d517244f4594b6c2a3eed968e8ed'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:17.821042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 888/1779] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:17 2022] DELETE /identity/v3/users/19b7d517244f4594b6c2a3eed968e8ed => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:17.822355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:17.824529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:17.915378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 892/1780] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:18.222473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003c71-819c-4a5c-b8c6-1934aa920bc7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:18.250847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:18.256222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:18.256520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:18.256809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] PATH_INFO: `/v3/projects/354154c7306a4d04917eaced20536ede` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:18.271783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354154c7306a4d04917eaced20536ede)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:18.286336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:18.553593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354154c7306a4d04917eaced20536ede', 'request_id': 'req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:18.588658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354154c7306a4d04917eaced20536ede', 'request_id': 'req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:18.603327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354154c7306a4d04917eaced20536ede', 'request_id': 'req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:18.654526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] The token cache is being invalidate because project 354154c7306a4d04917eaced20536ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:18.656755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:18.660384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a2b70c28-28bb-470b-ad29-3b7dbef8aeb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:18.666411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 889/1781] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:17 2022] DELETE /identity/v3/projects/354154c7306a4d04917eaced20536ede => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:18.671518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9cef-94b2-462b-bb23-bcda14d32a58 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:18.671802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9cef-94b2-462b-bb23-bcda14d32a58 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:18.672002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9cef-94b2-462b-bb23-bcda14d32a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:18.699547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2b5f9cef-94b2-462b-bb23-bcda14d32a58 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:18.703728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2b5f9cef-94b2-462b-bb23-bcda14d32a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:18.853223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a2f59-48dc-43c9-8d19-dd32a2972186 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:18.853721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a2f59-48dc-43c9-8d19-dd32a2972186 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:18.854334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a2f59-48dc-43c9-8d19-dd32a2972186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:18.857658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 893/1782] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:18.917263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8b4a2f59-48dc-43c9-8d19-dd32a2972186 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:18.925844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8b4a2f59-48dc-43c9-8d19-dd32a2972186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:18.961299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 890/1783] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:18.977430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f9cef-94b2-462b-bb23-bcda14d32a58 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:19.016246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f9cef-94b2-462b-bb23-bcda14d32a58 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:19.038166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:19.039881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.040944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:19.041953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:19.044621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:19.044957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:19.049226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:19.078255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 894/1784] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:19.084578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a2f59-48dc-43c9-8d19-dd32a2972186 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:19.099988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a2f59-48dc-43c9-8d19-dd32a2972186 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:19.113954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:19.114726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.114932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:19.115215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:19.115934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:19.119573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:19.192449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 891/1785] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:19 2022] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:19.194344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:19.208257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da96fda-f7f1-4b14-a704-de10d70047ca admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:19.347696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:19.349872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.350717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:19.351152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:19.354978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:19.364340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:19.425590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 895/1786] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:19 2022] POST /identity/v3/users => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:19.429690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:19.442081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94af79-94d8-40c3-a8f9-a243bcfa74f7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:19.447801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:19.448643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.449074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:19.449497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:19.450615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:19.457159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:19.487580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 892/1787] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:19.496030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:19.521967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea51c4-667a-42ff-8605-62e6f933cfa0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:19.534991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519fb2-fe56-406c-bc7d-50cc3f5d281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:19.536732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519fb2-fe56-406c-bc7d-50cc3f5d281c admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.537016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519fb2-fe56-406c-bc7d-50cc3f5d281c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:19.537661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519fb2-fe56-406c-bc7d-50cc3f5d281c admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:19.538534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c519fb2-fe56-406c-bc7d-50cc3f5d281c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:19.541443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c519fb2-fe56-406c-bc7d-50cc3f5d281c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:19.583439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 896/1788] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:19.584861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:19.605725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59839b-ed68-4862-adab-40fbf7d50b79 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:19.623314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:19.624822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.625050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:19.625328 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] PATH_INFO: `/v3/projects/01f409b35a0547f0a4e29e4017ade9c8/users/06c971d1ef6749cf9396fd1cde15a76a/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:19.661234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f409b35a0547f0a4e29e4017ade9c8, user_id=06c971d1ef6749cf9396fd1cde15a76a, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:19.688847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:19.741739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 893/1789] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:19 2022] PUT /identity/v3/projects/01f409b35a0547f0a4e29e4017ade9c8/users/06c971d1ef6749cf9396fd1cde15a76a/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:19.748074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:19.748669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfb0ac-d669-4e0f-a353-8f6fa9119d90 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.748964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfb0ac-d669-4e0f-a353-8f6fa9119d90 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:19.750922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:19.751883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfb0ac-d669-4e0f-a353-8f6fa9119d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:19.827067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-fcdfb0ac-d669-4e0f-a353-8f6fa9119d90 None None] MFA Rules not processed for user `06c971d1ef6749cf9396fd1cde15a76a`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:19.835334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fcdfb0ac-d669-4e0f-a353-8f6fa9119d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:19.979597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648669ca-456b-46e8-9005-eac5c0819d91 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:19.992003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:19.994897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:19.997172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.000065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] PATH_INFO: `/v3/projects/1afd6e2ac0f541a385284494d820652d` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.004575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afd6e2ac0f541a385284494d820652d)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.007870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.117531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 897/1790] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:20.125632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfb0ac-d669-4e0f-a353-8f6fa9119d90 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.186206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfb0ac-d669-4e0f-a353-8f6fa9119d90 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.205628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.213115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.213115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.213115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.213115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.213115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.292788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afd6e2ac0f541a385284494d820652d', 'request_id': 'req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:20.299191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 898/1791] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:20 2022] POST /identity/v3/projects => generated 401 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:20.303656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.347829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afd6e2ac0f541a385284494d820652d', 'request_id': 'req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:20.362164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afd6e2ac0f541a385284494d820652d', 'request_id': 'req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:20.396314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] The token cache is being invalidate because project 1afd6e2ac0f541a385284494d820652d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:20.396605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:20.401140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4a2face7-1a1f-4f03-af20-78ed2e7c26f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:20.407447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 894/1792] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:19 2022] DELETE /identity/v3/projects/1afd6e2ac0f541a385284494d820652d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:20.416982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba716c1-c236-4fa5-b984-4eb4359fe28a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.431900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba716c1-c236-4fa5-b984-4eb4359fe28a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.432498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba716c1-c236-4fa5-b984-4eb4359fe28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.455420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1189bd2-070c-4bd0-ac26-d5c3ad9480e0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.462794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.463795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.464304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.464892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.466640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.469108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.499850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 899/1793] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:20 2022] POST /identity/v3/users => generated 307 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:20.502959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.507064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:20.539104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f3cb9-986f-4b19-b853-3230bef49082 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.541243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6ba716c1-c236-4fa5-b984-4eb4359fe28a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:20.542682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6ba716c1-c236-4fa5-b984-4eb4359fe28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:20.547151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.547843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.548133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.548417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.549156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.550810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.566796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 895/1794] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:20.575375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522dde1-6a5d-4338-a02d-bd99f3fd277f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.575751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522dde1-6a5d-4338-a02d-bd99f3fd277f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.576038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522dde1-6a5d-4338-a02d-bd99f3fd277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.588867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 900/1795] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:20.593031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.609189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c522dde1-6a5d-4338-a02d-bd99f3fd277f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:20.610346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c522dde1-6a5d-4338-a02d-bd99f3fd277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:20.617173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9875ed2-aa8a-4127-8fc8-3841b50e50f7 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.619968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 896/1796] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:20.623715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522dde1-6a5d-4338-a02d-bd99f3fd277f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.627550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.628903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.629196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.629463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] PATH_INFO: `/v3/projects/ee384273f4194b1a9e69be6acf90956e/users/dde92a96bdbb46d29d8dd9661f1bac0d/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.633874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522dde1-6a5d-4338-a02d-bd99f3fd277f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.639077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.640031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.640532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.641036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.642121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:20.642626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.644418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.650163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee384273f4194b1a9e69be6acf90956e, user_id=dde92a96bdbb46d29d8dd9661f1bac0d, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.653474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.656853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 897/1797] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:45:20.661379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.674635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce34f8f-83f4-434a-acbf-879fc0463a03 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.677785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 901/1798] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:20 2022] PUT /identity/v3/projects/ee384273f4194b1a9e69be6acf90956e/users/dde92a96bdbb46d29d8dd9661f1bac0d/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:20.679206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.740434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.743042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.743042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.743042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.743042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.744986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.753715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cadf2-b73f-49a0-aaba-a0876f47e360 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.758732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.759408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.759691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.760078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.760874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.762578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.774039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 902/1799] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:45:20.778559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 898/1800] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:20 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:20.778825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.782958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.792936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a926c-2e8c-4d5a-be49-81ef9bb440a7 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.859930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345fab-18a5-4441-95fb-181f054ccf99 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.861198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d156ee2-6fa7-4e98-81c7-4cbffd3f584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.862397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d156ee2-6fa7-4e98-81c7-4cbffd3f584e admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.862678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d156ee2-6fa7-4e98-81c7-4cbffd3f584e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.862953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d156ee2-6fa7-4e98-81c7-4cbffd3f584e admin admin] PATH_INFO: `/v3/projects/ee384273f4194b1a9e69be6acf90956e/users/dde92a96bdbb46d29d8dd9661f1bac0d/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.864932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d156ee2-6fa7-4e98-81c7-4cbffd3f584e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee384273f4194b1a9e69be6acf90956e, user_id=dde92a96bdbb46d29d8dd9661f1bac0d, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.865801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:20.866467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.866875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.867144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.867687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d156ee2-6fa7-4e98-81c7-4cbffd3f584e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.867891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:20.874732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:20.890621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 903/1801] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:20 2022] PUT /identity/v3/projects/ee384273f4194b1a9e69be6acf90956e/users/dde92a96bdbb46d29d8dd9661f1bac0d/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:20.895259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:20.895392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:20.895587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:20.902909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 899/1802] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:20 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:20.907449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:20.918842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4231f-e1d3-491c-a792-330c2e4ae04f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:20.929310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] MFA Rules not processed for user `dde92a96bdbb46d29d8dd9661f1bac0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:20.930932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.000416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.004658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.005442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.005938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.007426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.010032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.031973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 900/1803] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:21.033464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.038902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 904/1804] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:21.047242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45958640-eccb-4da4-994b-c1027f7030c1 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.055419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.057044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.057561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.059860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.060003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.060227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.061365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.063796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.087088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 901/1805] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:21.092443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.107875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b7765-4361-418b-ba93-849a460b94de admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.114041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e0758-ad7c-41f9-bc90-103d7d161632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.114941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e0758-ad7c-41f9-bc90-103d7d161632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.115363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e0758-ad7c-41f9-bc90-103d7d161632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.116157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e0758-ad7c-41f9-bc90-103d7d161632 admin admin] PATH_INFO: `/v3/projects/ab30135321524961a1a39d7c64246d74/users/71d2c5d6537c4a128c38bf60c60824ef/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.137557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e0758-ad7c-41f9-bc90-103d7d161632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab30135321524961a1a39d7c64246d74, user_id=71d2c5d6537c4a128c38bf60c60824ef, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.140712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e0758-ad7c-41f9-bc90-103d7d161632 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.172036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 902/1806] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:21 2022] PUT /identity/v3/projects/ab30135321524961a1a39d7c64246d74/users/71d2c5d6537c4a128c38bf60c60824ef/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:21.174109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0638be-afcc-4bda-9c14-72fa88208cbf None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.176969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d05f-bc0a-42b8-9f05-e4a957080347 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.177266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d05f-bc0a-42b8-9f05-e4a957080347 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.177542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d05f-bc0a-42b8-9f05-e4a957080347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.240122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.241163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.241523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.241904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.246264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-34c6d05f-bc0a-42b8-9f05-e4a957080347 None None] MFA Rules not processed for user `71d2c5d6537c4a128c38bf60c60824ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:21.247654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-34c6d05f-bc0a-42b8-9f05-e4a957080347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.312985 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.314596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.328186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 905/1807] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:21.329138 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.329971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 903/1808] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:21.331529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.335818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d05f-bc0a-42b8-9f05-e4a957080347 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.428385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d05f-bc0a-42b8-9f05-e4a957080347 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.434282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.435022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.435603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.435961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.437237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.439511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.440764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ed1c-b966-4821-b4d5-a3dd9a81cbec service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.446608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.447709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.448170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.448731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] PATH_INFO: `/v3/users/b0eee535debb4eaf9e451d7833b2115c` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.450405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eee535debb4eaf9e451d7833b2115c)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.453266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.478500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 904/1809] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:21 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:21.479478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.513022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eee535debb4eaf9e451d7833b2115c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.521720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eee535debb4eaf9e451d7833b2115c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.522338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eee535debb4eaf9e451d7833b2115c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.539658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eee535debb4eaf9e451d7833b2115c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.540604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eee535debb4eaf9e451d7833b2115c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.550090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770e580-ddda-4eaa-b87f-2012d3751e34 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.554051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.554695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.554972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.555243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.556578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 906/1810] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:21 2022] DELETE /identity/v3/users/b0eee535debb4eaf9e451d7833b2115c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:21.557080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.557517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.567046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.637205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.638876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.644328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57092a-474d-4498-8954-f8368f984daa admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.649979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.650935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.651363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.651741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.652727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.654906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.661693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 905/1811] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:21.688923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 907/1812] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:21 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:21.692672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.781501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.783342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.784995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abfba-36f8-41e9-8d69-0a1e5e12a7a6 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.799193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.801331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.801612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.802520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9e54-44a1-4426-b3d5-a14d80a855d9 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.803135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.803889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.818882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.819793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.820703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.820983 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.821257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] PATH_INFO: `/v3/projects/15753a2516ea48138f7fa6ae87ff81a3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.822924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15753a2516ea48138f7fa6ae87ff81a3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.828709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.843940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 906/1813] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:21.844699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.854931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e89cee-d4cb-4a73-9bf8-0de5cc2926de admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.867561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.868271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.868562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.868838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:21.869685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:21.871647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:21.890499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 907/1814] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:21.891641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.904687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca9f2-c8e7-4ef5-a7e5-77eda13b38fd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:21.917674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15753a2516ea48138f7fa6ae87ff81a3', 'request_id': 'req-727b1b11-0649-4c68-a556-0ac211a5cc37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.928115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15753a2516ea48138f7fa6ae87ff81a3', 'request_id': 'req-727b1b11-0649-4c68-a556-0ac211a5cc37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.937971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15753a2516ea48138f7fa6ae87ff81a3', 'request_id': 'req-727b1b11-0649-4c68-a556-0ac211a5cc37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.950989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] The token cache is being invalidate because project 15753a2516ea48138f7fa6ae87ff81a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:21.951282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.953306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:21.956192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 908/1815] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:21 2022] DELETE /identity/v3/projects/15753a2516ea48138f7fa6ae87ff81a3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:21.960482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:21.962663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:21.990643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f7c1a-b412-4e55-a844-18083f9e985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:21.991613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7c1a-b412-4e55-a844-18083f9e985b admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:21.991893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7c1a-b412-4e55-a844-18083f9e985b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:21.992171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7c1a-b412-4e55-a844-18083f9e985b admin admin] PATH_INFO: `/v3/projects/f7c1fff0e0c349fa822d8c53abfed278/users/ff4099f0a66244a08c7614afb6a929ab/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.015275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f7c1a-b412-4e55-a844-18083f9e985b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c1fff0e0c349fa822d8c53abfed278, user_id=ff4099f0a66244a08c7614afb6a929ab, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:22.018364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f7c1a-b412-4e55-a844-18083f9e985b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:22.035216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 908/1816] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:21 2022] PUT /identity/v3/projects/f7c1fff0e0c349fa822d8c53abfed278/users/ff4099f0a66244a08c7614afb6a929ab/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:22.055038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:22.055376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:22.055637 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.094105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1b11-0649-4c68-a556-0ac211a5cc37 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:22.103501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] MFA Rules not processed for user `ff4099f0a66244a08c7614afb6a929ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:22.107990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:22.228465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:22.236140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:22.236448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:22.236766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] PATH_INFO: `/v3/users/3b86410214454209a67fffc949c3b5fc` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.238271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b86410214454209a67fffc949c3b5fc)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:22.243828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:22.277362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 909/1817] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:22.282571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:22.284790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:22.302920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e850b5-b2df-4997-8d37-45ad257f4f25 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:22.344341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:22.346691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:22.349209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:22.349862 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.353175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:22.364632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:22.417042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b86410214454209a67fffc949c3b5fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:22.435468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b86410214454209a67fffc949c3b5fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:22.436203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b86410214454209a67fffc949c3b5fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:22.442006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 910/1818] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:22 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:22.445058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:22.449078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:22.473691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b86410214454209a67fffc949c3b5fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:22.475036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b86410214454209a67fffc949c3b5fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:22.514263 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 909/1819] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:21 2022] DELETE /identity/v3/users/3b86410214454209a67fffc949c3b5fc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:22.569963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dbe10-30a6-40f1-be07-f99d8aaaea37 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:22.678686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:22.679685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:22.680889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:22.681625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.682218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:22.684660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:22.722236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 911/1820] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:22 2022] POST /identity/v3/users => generated 299 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:22.726121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:22.738299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dceb5-7ea1-40fc-bd81-1f6b5493e918 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:22.743759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:22.744514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:22.744876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:22.745226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.746073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:22.748223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:22.759291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 910/1821] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:45:22.763681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:22.775450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6d791-e939-48a2-b997-c79b71d25165 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:22.782433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:22.783932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:22.784317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:22.784706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] PATH_INFO: `/v3/projects/471f6c554d21447690b0ad55e63a0a65/users/80219377e3e94e429be53ac700b11e21/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.815383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] RBAC: Authorizing `identity:create_grant(project_id=471f6c554d21447690b0ad55e63a0a65, user_id=80219377e3e94e429be53ac700b11e21, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:22.818401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:22.847869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 912/1822] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:22 2022] PUT /identity/v3/projects/471f6c554d21447690b0ad55e63a0a65/users/80219377e3e94e429be53ac700b11e21/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:22.851910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:22.870666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893768f-4993-43bd-a193-d03896ed4730 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:22.957180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e18c0f-68f4-4e97-9ba7-ad9b8129609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:22.957908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e18c0f-68f4-4e97-9ba7-ad9b8129609e admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:22.958196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e18c0f-68f4-4e97-9ba7-ad9b8129609e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:22.958769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e18c0f-68f4-4e97-9ba7-ad9b8129609e admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:22.959259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e18c0f-68f4-4e97-9ba7-ad9b8129609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:22.961576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e18c0f-68f4-4e97-9ba7-ad9b8129609e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:22.974742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 911/1823] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:22.978990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:22.992607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62388758-4c1e-4b2b-a948-4e9ee640139e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:23.002765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:23.004214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:23.004712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:23.005088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] PATH_INFO: `/v3/projects/471f6c554d21447690b0ad55e63a0a65/users/80219377e3e94e429be53ac700b11e21/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:23.008111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] RBAC: Authorizing `identity:create_grant(project_id=471f6c554d21447690b0ad55e63a0a65, user_id=80219377e3e94e429be53ac700b11e21, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:23.011296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:23.026535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 913/1824] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:22 2022] PUT /identity/v3/projects/471f6c554d21447690b0ad55e63a0a65/users/80219377e3e94e429be53ac700b11e21/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:23.038254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:23.038631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:23.038831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:23.077198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] MFA Rules not processed for user `80219377e3e94e429be53ac700b11e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:23.078726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:23.173455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 912/1825] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:23.190864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:23.193198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:23.357574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f556-f64f-4a58-a3a1-ba54afd72def admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:23.360215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff61a0-cddf-4a13-b5e8-34f172d6a82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:23.360956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff61a0-cddf-4a13-b5e8-34f172d6a82b service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:23.361241 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff61a0-cddf-4a13-b5e8-34f172d6a82b service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:23.361517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff61a0-cddf-4a13-b5e8-34f172d6a82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:23.369073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-17ff61a0-cddf-4a13-b5e8-34f172d6a82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:23.387572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:23.389095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:23.510801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff61a0-cddf-4a13-b5e8-34f172d6a82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:23.513332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff61a0-cddf-4a13-b5e8-34f172d6a82b service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:23.544353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 914/1826] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:23.627116 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6363-09c3-4517-b85e-339f4a77d720 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:23.642660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:23.645287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:23.645596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:23.646580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] PATH_INFO: `/v3/projects/fc65b9e9da164ab18dd3d095d45961a3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:23.651078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc65b9e9da164ab18dd3d095d45961a3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:23.659553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:23.729749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc65b9e9da164ab18dd3d095d45961a3', 'request_id': 'req-4703cea3-5362-42e3-9cc8-e34974d3891c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:23.743098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc65b9e9da164ab18dd3d095d45961a3', 'request_id': 'req-4703cea3-5362-42e3-9cc8-e34974d3891c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:23.756081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc65b9e9da164ab18dd3d095d45961a3', 'request_id': 'req-4703cea3-5362-42e3-9cc8-e34974d3891c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:23.772498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] The token cache is being invalidate because project fc65b9e9da164ab18dd3d095d45961a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:23.773736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:23.774601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4703cea3-5362-42e3-9cc8-e34974d3891c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:23.776699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 913/1827] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:23 2022] DELETE /identity/v3/projects/fc65b9e9da164ab18dd3d095d45961a3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:23.782332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101fb13-d904-4ab7-b556-fcb0963150da None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:23.782332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101fb13-d904-4ab7-b556-fcb0963150da None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:23.782747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101fb13-d904-4ab7-b556-fcb0963150da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:23.813639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f101fb13-d904-4ab7-b556-fcb0963150da None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:23.828000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f101fb13-d904-4ab7-b556-fcb0963150da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:23.979589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 915/1828] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:23.981670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de438-51cc-4aa1-9ff3-d8eb4ea9b372 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:23.982016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de438-51cc-4aa1-9ff3-d8eb4ea9b372 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:23.982330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de438-51cc-4aa1-9ff3-d8eb4ea9b372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.020878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a28de438-51cc-4aa1-9ff3-d8eb4ea9b372 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:24.021645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a28de438-51cc-4aa1-9ff3-d8eb4ea9b372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:24.047611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 914/1829] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:24.052771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101fb13-d904-4ab7-b556-fcb0963150da None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:24.067602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101fb13-d904-4ab7-b556-fcb0963150da None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:24.076429 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:24.078553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:24.078983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:24.080325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.081304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:24.081737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:24.085489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:24.106907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 916/1830] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:24.109363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de438-51cc-4aa1-9ff3-d8eb4ea9b372 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:24.119411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de438-51cc-4aa1-9ff3-d8eb4ea9b372 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:24.125596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:24.126358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:24.126740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:24.127117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.127927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:24.130576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:24.187696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:24.190144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 915/1831] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:24 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:24.205926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25864ac-73eb-47f5-9c78-f406ff83a3e4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:24.384079 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:24.388617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:24.388896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:24.390228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.390823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:24.392806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:24.446834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 917/1832] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:24 2022] POST /identity/v3/users => generated 282 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:24.451208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:24.465051 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc22d-97cd-4818-bfcf-3e645b240ba9 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:24.476672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:24.479489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:24.479959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:24.480389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.482284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:24.488858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:24.516230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:24.529328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 916/1833] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:24.529822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b9ca-e69a-401d-af0c-7fef0a5bcdf7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:24.540387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da08e2e-d209-4176-a1dd-49b674d884dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:24.541165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da08e2e-d209-4176-a1dd-49b674d884dc admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:24.541526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da08e2e-d209-4176-a1dd-49b674d884dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:24.541905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da08e2e-d209-4176-a1dd-49b674d884dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.542867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da08e2e-d209-4176-a1dd-49b674d884dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:24.546582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da08e2e-d209-4176-a1dd-49b674d884dc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:24.563888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:24.564824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 918/1834] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:24.575903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185e4c-053b-4df5-b9fc-9dd67e748dbc admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:24.583325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:24.584377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:24.584820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:24.585178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] PATH_INFO: `/v3/projects/e57de30ceabb4bcb9d7cc1d27fe77306/users/eb5e2f5db3634d8aa5bc633d496c5810/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.616697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57de30ceabb4bcb9d7cc1d27fe77306, user_id=eb5e2f5db3634d8aa5bc633d496c5810, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:24.643910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:24.758027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 917/1835] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:24 2022] PUT /identity/v3/projects/e57de30ceabb4bcb9d7cc1d27fe77306/users/eb5e2f5db3634d8aa5bc633d496c5810/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:24.772544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4562-fafe-4ec8-a79f-40b613a3c534 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:24.773135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4562-fafe-4ec8-a79f-40b613a3c534 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:24.773512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4562-fafe-4ec8-a79f-40b613a3c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:24.807491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-fe4e4562-fafe-4ec8-a79f-40b613a3c534 None None] MFA Rules not processed for user `eb5e2f5db3634d8aa5bc633d496c5810`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:24.808716 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fe4e4562-fafe-4ec8-a79f-40b613a3c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:24.904244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 919/1836] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:24.909056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.016019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feecf2-ecff-433a-a13e-c713a37719ae admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:25.026142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:25.027090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.028173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.028697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.030324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:25.033429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:25.089596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4562-fafe-4ec8-a79f-40b613a3c534 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.089957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 918/1837] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:24 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:25.115783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4562-fafe-4ec8-a79f-40b613a3c534 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:25.304325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:25.305377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.305675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.306083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.307701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:25.310301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:25.354696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.363633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 920/1838] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:25 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:25.375956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af311b18-d945-4a8c-95e5-8de2f15ffd66 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:25.389193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:25.390445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.391005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.391453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.392538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:25.403187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:25.447153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 919/1839] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:45:25.451628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.470463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f94217-30fe-43f8-ac9e-703fd0a5b6d0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:25.475960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4503e-0db5-4a6f-a978-abbc91604064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:25.477652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4503e-0db5-4a6f-a978-abbc91604064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.478319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4503e-0db5-4a6f-a978-abbc91604064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.479370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4503e-0db5-4a6f-a978-abbc91604064 admin admin] PATH_INFO: `/v3/projects/05757c8877864894a19e46a615c2ba1a/users/308730a70988454d82565cf1245b6f76/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.511664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4503e-0db5-4a6f-a978-abbc91604064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05757c8877864894a19e46a615c2ba1a, user_id=308730a70988454d82565cf1245b6f76, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:25.516459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4503e-0db5-4a6f-a978-abbc91604064 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:25.543752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 921/1840] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:25 2022] PUT /identity/v3/projects/05757c8877864894a19e46a615c2ba1a/users/308730a70988454d82565cf1245b6f76/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:25.548144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.562247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc2b1e-c35b-482b-946a-c0f934d9a8fa admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:25.622007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f696441-a93d-4765-9102-d9a1ee6d3649 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.622502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f696441-a93d-4765-9102-d9a1ee6d3649 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.622927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f696441-a93d-4765-9102-d9a1ee6d3649 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.624908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 922/1841] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:45:25.634205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92209-cfc7-4fcf-9d55-45b613d9a0eb None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.634893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92209-cfc7-4fcf-9d55-45b613d9a0eb None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.635599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92209-cfc7-4fcf-9d55-45b613d9a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.682869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7fe92209-cfc7-4fcf-9d55-45b613d9a0eb None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:25.684508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7fe92209-cfc7-4fcf-9d55-45b613d9a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:25.686773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:25.687566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.687886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.688163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.689650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:25.692673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:25.721276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 920/1842] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:25.722744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.725084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:25.802529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 923/1843] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:45:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:25.803603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe92209-cfc7-4fcf-9d55-45b613d9a0eb None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.817821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe92209-cfc7-4fcf-9d55-45b613d9a0eb None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:25.819959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae4eb-0d4d-448c-8681-32a688d6cf79 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:25.824316 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b389727-9118-4142-9b20-984bd8b933f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:25.825401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389727-9118-4142-9b20-984bd8b933f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.825666 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:25.825872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389727-9118-4142-9b20-984bd8b933f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.826352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389727-9118-4142-9b20-984bd8b933f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.831439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0b389727-9118-4142-9b20-984bd8b933f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:25.833332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.833522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.833960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] PATH_INFO: `/v3/projects/05757c8877864894a19e46a615c2ba1a/users/308730a70988454d82565cf1245b6f76/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:25.838439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05757c8877864894a19e46a615c2ba1a, user_id=308730a70988454d82565cf1245b6f76, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:25.846444 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:25.865241 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 924/1844] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:25 2022] PUT /identity/v3/projects/05757c8877864894a19e46a615c2ba1a/users/308730a70988454d82565cf1245b6f76/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:25.866404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:25.879437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:25.958497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b389727-9118-4142-9b20-984bd8b933f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:25.962329 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b389727-9118-4142-9b20-984bd8b933f2 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:25.991207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 921/1845] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:25.995560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:25.996043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:25.999927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:26.021105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969b95-04c0-4b52-a5a2-3a4c3fe98c68 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:26.034980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:26.037789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:26.039747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:26.040142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:26.069502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:26.073005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:26.092423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] MFA Rules not processed for user `308730a70988454d82565cf1245b6f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:26.093661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:26.096721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 925/1846] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:26.265607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 922/1847] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:26.528032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:26.529736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:26.676641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1fe9d-fb9e-4ff0-87aa-fdaf69f10eb3 service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:26.690584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:26.691547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:26.692130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:26.692571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:26.718680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:26.720300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:26.744726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 926/1848] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:26.892133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:26.895140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.021804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:27.033521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c278e5c-96cc-4a99-be9f-3fa608c8375b service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:27.039552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27807b62-6b95-4428-ab1c-281834bfbd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:27.041156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807b62-6b95-4428-ab1c-281834bfbd10 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.041598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807b62-6b95-4428-ab1c-281834bfbd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.042193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807b62-6b95-4428-ab1c-281834bfbd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.070845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76577b-040b-45b9-ab2b-73c3bb87d738 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:27.076879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:27.079657 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.080153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.081674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] PATH_INFO: `/v3/users/820d770cf9af470ca064f25c9a96b523` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.083741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=820d770cf9af470ca064f25c9a96b523)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:27.088207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:27.183507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27807b62-6b95-4428-ab1c-281834bfbd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:27.195999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27807b62-6b95-4428-ab1c-281834bfbd10 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:27.223288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820d770cf9af470ca064f25c9a96b523'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.241159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 927/1849] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:27.255797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820d770cf9af470ca064f25c9a96b523'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.256883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820d770cf9af470ca064f25c9a96b523'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.283470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820d770cf9af470ca064f25c9a96b523'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.286456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820d770cf9af470ca064f25c9a96b523'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.315879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 923/1850] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:26 2022] DELETE /identity/v3/users/820d770cf9af470ca064f25c9a96b523 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:27.320508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.321103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.321594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.356046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:27.357273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.420300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:27.422041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.511826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c9a42-704e-44af-a351-aaba432a6e4b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:27.515854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 928/1851] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:27.520096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:27.521153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.521540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.521962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.524252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.544372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:27.546016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.564358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687980-e65a-4eba-b19b-ea34445975b5 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:27.571893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:27.572998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.573405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.573826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] PATH_INFO: `/v3/users/06c971d1ef6749cf9396fd1cde15a76a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.575764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c971d1ef6749cf9396fd1cde15a76a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:27.580303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:27.671086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:27.672817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:27.676707 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c971d1ef6749cf9396fd1cde15a76a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.683728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 924/1852] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:27.684571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c971d1ef6749cf9396fd1cde15a76a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.685278 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c971d1ef6749cf9396fd1cde15a76a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.694015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:27.695679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.708828 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c971d1ef6749cf9396fd1cde15a76a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.710002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0b522584-d438-4e48-9562-574cc35c1bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c971d1ef6749cf9396fd1cde15a76a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:27.729944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 929/1853] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:27 2022] DELETE /identity/v3/users/06c971d1ef6749cf9396fd1cde15a76a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:27.731681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.732025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.732310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.755396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:27.756719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.775503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfadc9b-bb27-403f-ac87-85332b9c12b7 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:27.839972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 930/1854] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:27.850343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:27.850789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca7e3d-65bc-47ed-9f0f-cf3f0a68acb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:27.851457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca7e3d-65bc-47ed-9f0f-cf3f0a68acb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.851740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca7e3d-65bc-47ed-9f0f-cf3f0a68acb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.852018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca7e3d-65bc-47ed-9f0f-cf3f0a68acb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.852112 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.853901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-72ca7e3d-65bc-47ed-9f0f-cf3f0a68acb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:27.864195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acad69-7aca-447c-9dc6-1be921f31485 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:27.868290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca7e3d-65bc-47ed-9f0f-cf3f0a68acb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:27.868974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b60f-aa2b-4c5a-82aa-db5ab02da7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:27.869631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b60f-aa2b-4c5a-82aa-db5ab02da7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:27.869792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca7e3d-65bc-47ed-9f0f-cf3f0a68acb0 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:27.869997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b60f-aa2b-4c5a-82aa-db5ab02da7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:27.870230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b60f-aa2b-4c5a-82aa-db5ab02da7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:27.880360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b60f-aa2b-4c5a-82aa-db5ab02da7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:27.881839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b60f-aa2b-4c5a-82aa-db5ab02da7e8 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:27.882369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 925/1855] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:27.892712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 931/1856] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:28.019691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1d07-09c8-4288-ae90-e8d319adf23e None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:28.020202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1d07-09c8-4288-ae90-e8d319adf23e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:28.020288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1d07-09c8-4288-ae90-e8d319adf23e None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:28.021766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 926/1857] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:45:28.034347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:28.034656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:28.034904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:28.066029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:28.067435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:28.189436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 932/1858] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:45:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:28.328485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1d07-09c8-4288-ae90-e8d319adf23e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:28.331535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-157b1d07-09c8-4288-ae90-e8d319adf23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:28.368902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1d07-09c8-4288-ae90-e8d319adf23e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:28.382730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:28.383590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:28.384068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:28.384443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:28.396961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:28.400510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:28.416827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 927/1859] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:28.756297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:28.760822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:28.783206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ba534-bd1a-4d1c-93ce-87d06ddf096c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:28.792259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:28.793498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:28.794544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:28.796105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] PATH_INFO: `/v3/projects/01f409b35a0547f0a4e29e4017ade9c8` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:28.797610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f409b35a0547f0a4e29e4017ade9c8)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:28.799799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:28.915116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f409b35a0547f0a4e29e4017ade9c8', 'request_id': 'req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:28.919561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:28.922004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:28.933434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f409b35a0547f0a4e29e4017ade9c8', 'request_id': 'req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:28.949798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d103eb7-1790-41dd-bf66-052910986d16 service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:28.949933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f409b35a0547f0a4e29e4017ade9c8', 'request_id': 'req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:28.979854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] The token cache is being invalidate because project 01f409b35a0547f0a4e29e4017ade9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:28.980275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:28.991291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:28.995828 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 933/1860] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:28 2022] DELETE /identity/v3/projects/01f409b35a0547f0a4e29e4017ade9c8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:29.013820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.017461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:29.071531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.072444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.072979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.073401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] PATH_INFO: `/v3/projects/761b150df54d48fe8b96f7233cecaab7` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.074876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=761b150df54d48fe8b96f7233cecaab7)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.078030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.155397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa6e7-5942-4a94-b9d0-3b97d5b0b8a7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.163340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761b150df54d48fe8b96f7233cecaab7', 'request_id': 'req-a725dfd1-ac65-411b-9490-45de7a386d8c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.181187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761b150df54d48fe8b96f7233cecaab7', 'request_id': 'req-a725dfd1-ac65-411b-9490-45de7a386d8c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.191579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761b150df54d48fe8b96f7233cecaab7', 'request_id': 'req-a725dfd1-ac65-411b-9490-45de7a386d8c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.204897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] The token cache is being invalidate because project 761b150df54d48fe8b96f7233cecaab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:29.205553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.206736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a725dfd1-ac65-411b-9490-45de7a386d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.208962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 928/1861] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:28 2022] DELETE /identity/v3/projects/761b150df54d48fe8b96f7233cecaab7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:29.213414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19c32-5bdd-4c7d-8f12-733e59f1ad93 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.215804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19c32-5bdd-4c7d-8f12-733e59f1ad93 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.216319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19c32-5bdd-4c7d-8f12-733e59f1ad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.241079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f3b19c32-5bdd-4c7d-8f12-733e59f1ad93 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:29.244459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f3b19c32-5bdd-4c7d-8f12-733e59f1ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:29.253142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.254073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.254357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.254635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] PATH_INFO: `/v3/users/dde92a96bdbb46d29d8dd9661f1bac0d` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.256725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde92a96bdbb46d29d8dd9661f1bac0d)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.257143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 929/1862] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:29.259165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.264554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52769f2-2dda-4139-9eb4-1cdf6d20262d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.264822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52769f2-2dda-4139-9eb4-1cdf6d20262d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.265248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52769f2-2dda-4139-9eb4-1cdf6d20262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.286773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a52769f2-2dda-4139-9eb4-1cdf6d20262d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:29.288669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a52769f2-2dda-4139-9eb4-1cdf6d20262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:29.298813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 930/1863] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:29.303329 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52769f2-2dda-4139-9eb4-1cdf6d20262d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.312941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52769f2-2dda-4139-9eb4-1cdf6d20262d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.318403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.319073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.319374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.319640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.320381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:29.320693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.322561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.324198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde92a96bdbb46d29d8dd9661f1bac0d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.337410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde92a96bdbb46d29d8dd9661f1bac0d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.338698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde92a96bdbb46d29d8dd9661f1bac0d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.340510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 931/1864] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:29.346341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.348289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:29.363890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde92a96bdbb46d29d8dd9661f1bac0d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.364749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde92a96bdbb46d29d8dd9661f1bac0d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:29.367480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae848a8-bb06-4265-b9bc-875bff2ddc45 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.377560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.378531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.378929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.379658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.380631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.383140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.388533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 934/1865] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:29 2022] DELETE /identity/v3/users/dde92a96bdbb46d29d8dd9661f1bac0d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:29.462286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 932/1866] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:29 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:29.466292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.688125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b30d5-bec6-4b1f-9ca4-a2abdc0d77a0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.809907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.810635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.811029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.811843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.812546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.814505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.847486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 935/1867] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:29 2022] POST /identity/v3/users => generated 286 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:29.851584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.866552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41aa7c-1a92-4803-b7d7-bbdbc7d258c7 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.872065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.872811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.874143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.874143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.875035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.876826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.891513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.892012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 933/1868] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:29.901547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb680ac-ac99-4dd5-97d2-b03dc77d1701 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.906786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.907573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.907916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.908254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.909103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.910955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.922706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 936/1869] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:29.926925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.938758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf569230-82af-4fc3-b619-868abf04a784 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.944548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbf2d6-2659-44ef-90c2-7b279a7f04da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.945587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbf2d6-2659-44ef-90c2-7b279a7f04da admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.946460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbf2d6-2659-44ef-90c2-7b279a7f04da admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.946460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbf2d6-2659-44ef-90c2-7b279a7f04da admin admin] PATH_INFO: `/v3/projects/85d9c5fb951c41ebb6d89808067443e8/users/c0a778828fcc4c26b7ba8822ed9bbc2b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.947912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:29.949853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:29.963223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d26d-73e9-41ad-b4ed-cb6d6f18bc9b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:29.968976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:29.969951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:29.970299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:29.970642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] PATH_INFO: `/v3/projects/ee384273f4194b1a9e69be6acf90956e` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:29.971952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee384273f4194b1a9e69be6acf90956e)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.973987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:29.974704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbf2d6-2659-44ef-90c2-7b279a7f04da admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d9c5fb951c41ebb6d89808067443e8, user_id=c0a778828fcc4c26b7ba8822ed9bbc2b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:29.978651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbf2d6-2659-44ef-90c2-7b279a7f04da admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.001298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 934/1870] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:29 2022] PUT /identity/v3/projects/85d9c5fb951c41ebb6d89808067443e8/users/c0a778828fcc4c26b7ba8822ed9bbc2b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:30.013083 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.013514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.013824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.038635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee384273f4194b1a9e69be6acf90956e', 'request_id': 'req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:30.042768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] MFA Rules not processed for user `c0a778828fcc4c26b7ba8822ed9bbc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:30.044656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:30.046756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee384273f4194b1a9e69be6acf90956e', 'request_id': 'req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:30.054279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee384273f4194b1a9e69be6acf90956e', 'request_id': 'req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:30.065091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] The token cache is being invalidate because project ee384273f4194b1a9e69be6acf90956e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:30.065387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:30.066297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d7283802-ce9f-47d9-b54c-ceb71c8cb5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:30.069772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 937/1871] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:29 2022] DELETE /identity/v3/projects/ee384273f4194b1a9e69be6acf90956e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:30.072800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32dcff-a12c-42d6-bc82-329e3a2826f1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.073090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32dcff-a12c-42d6-bc82-329e3a2826f1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.073373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32dcff-a12c-42d6-bc82-329e3a2826f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.095019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-dd32dcff-a12c-42d6-bc82-329e3a2826f1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:30.096223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dd32dcff-a12c-42d6-bc82-329e3a2826f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:30.114632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 935/1872] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:30.119091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.120515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:30.189804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 938/1873] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:30.198897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc997fb-10a2-4465-977e-bcc3496d711b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.199194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc997fb-10a2-4465-977e-bcc3496d711b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.199550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc997fb-10a2-4465-977e-bcc3496d711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.223932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ffc997fb-10a2-4465-977e-bcc3496d711b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:30.225314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ffc997fb-10a2-4465-977e-bcc3496d711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:30.228487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbfc01-fde4-41a4-8e71-0c3649644c97 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.233863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.235252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.235453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 939/1874] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:30.235700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.235981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.236764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.238723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.240766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc997fb-10a2-4465-977e-bcc3496d711b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.256854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc997fb-10a2-4465-977e-bcc3496d711b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.262508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.263287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.263488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.263727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.265198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:30.266101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.267424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.283165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 940/1875] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:30.285874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 936/1876] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:30 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:30.287415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.298742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.310736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a66fa8-38fa-4585-abe8-c81c9955c9cd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.407729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac8bb-ae93-4bd2-802c-8a0ec9b63b02 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.408016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.409031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.410064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.410507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.411358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.413798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.414878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.414991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.415473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.415844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.416761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.419181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.451193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 941/1877] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:30 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:30.454422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.468496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731ac1-b1bd-4f32-ab22-054e5db5cd24 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.476614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.477695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.478128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.480687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.481632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.484315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 937/1878] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:30 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:30.485394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.486069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.516837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 942/1879] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:30.520162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.566875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4092-813c-4dd5-a194-aea524e1093d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.667496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.670259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.671235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.673830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] PATH_INFO: `/v3/projects/fc3513fbfe9348e3a00166d8d9c246c1/users/7fd914ac5e35438499db5f68efe5826f/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.677918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d4ad-a49e-4ff0-a3d0-6fe822e3f58a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.700514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.701467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.701931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.702302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.704021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.711209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.712260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3513fbfe9348e3a00166d8d9c246c1, user_id=7fd914ac5e35438499db5f68efe5826f, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.725153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:30.767793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 943/1880] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:30 2022] PUT /identity/v3/projects/fc3513fbfe9348e3a00166d8d9c246c1/users/7fd914ac5e35438499db5f68efe5826f/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:30.769402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.779694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 938/1881] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:30 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:30.784812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:30.823392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d778b-fb2b-44e7-ba27-f189d58b1d5e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.978542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b0e7-7f36-44ba-808b-bb83734a7cdd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:30.984145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:30.984805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:30.985147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:30.985469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:30.986239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:30.990168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.018882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 944/1882] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:31.020111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.034276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6e271-0ae2-4d2e-8783-ae67ff475f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.036901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6e271-0ae2-4d2e-8783-ae67ff475f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.037552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6e271-0ae2-4d2e-8783-ae67ff475f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.038016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b028f0-45fd-45f4-b8ca-0b27f04d32bd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.038452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6e271-0ae2-4d2e-8783-ae67ff475f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.041147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6e271-0ae2-4d2e-8783-ae67ff475f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.044497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.045027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6e271-0ae2-4d2e-8783-ae67ff475f08 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.046410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.046799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.047230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] PATH_INFO: `/v3/projects/fc3513fbfe9348e3a00166d8d9c246c1/users/7fd914ac5e35438499db5f68efe5826f/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.051513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3513fbfe9348e3a00166d8d9c246c1, user_id=7fd914ac5e35438499db5f68efe5826f, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.054846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.081041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 945/1883] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:31 2022] PUT /identity/v3/projects/fc3513fbfe9348e3a00166d8d9c246c1/users/7fd914ac5e35438499db5f68efe5826f/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:31.081041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.081319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 939/1884] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:31.083562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba12a9-0fdb-48cc-92c4-371110afb795 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.084389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba12a9-0fdb-48cc-92c4-371110afb795 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.086744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba12a9-0fdb-48cc-92c4-371110afb795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.133241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f1ba12a9-0fdb-48cc-92c4-371110afb795 None None] MFA Rules not processed for user `7fd914ac5e35438499db5f68efe5826f`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:31.134617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f1ba12a9-0fdb-48cc-92c4-371110afb795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:31.229587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0a57-d5d7-4971-b3aa-c7cf53094c08 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.238154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 940/1885] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:31.246610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.254590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.255450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.255922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.257058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.260087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.277159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 946/1886] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:31.282287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba12a9-0fdb-48cc-92c4-371110afb795 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.293834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba12a9-0fdb-48cc-92c4-371110afb795 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.299787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.300807 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8715fb-3a6a-43b5-b31d-775d81627ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.301869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8715fb-3a6a-43b5-b31d-775d81627ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.302259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8715fb-3a6a-43b5-b31d-775d81627ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.302639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8715fb-3a6a-43b5-b31d-775d81627ba2 admin admin] PATH_INFO: `/v3/projects/08921ebf060447db9ea8618d0c795b19/users/1a0e91753caf4d68bcf481e7934cec0a/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.303481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:31.320524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8715fb-3a6a-43b5-b31d-775d81627ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08921ebf060447db9ea8618d0c795b19, user_id=1a0e91753caf4d68bcf481e7934cec0a, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.323523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8715fb-3a6a-43b5-b31d-775d81627ba2 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.350361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 941/1887] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:31 2022] PUT /identity/v3/projects/08921ebf060447db9ea8618d0c795b19/users/1a0e91753caf4d68bcf481e7934cec0a/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:31.359204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754960a-f935-4a75-b01a-37b70585e42f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.359892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754960a-f935-4a75-b01a-37b70585e42f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.360009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754960a-f935-4a75-b01a-37b70585e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.402044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e754960a-f935-4a75-b01a-37b70585e42f None None] MFA Rules not processed for user `1a0e91753caf4d68bcf481e7934cec0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:31.403445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e754960a-f935-4a75-b01a-37b70585e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:31.422518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06db05-94f4-4282-92fc-3d00f22492a3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.495376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 942/1888] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:31.502049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.503027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.503402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.503849 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.507440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754960a-f935-4a75-b01a-37b70585e42f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.582747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754960a-f935-4a75-b01a-37b70585e42f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.588454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.589224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.589609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.590017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.590833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.593660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.595941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.597380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.610063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 947/1889] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:31.625753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 943/1890] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:31 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:31.629261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.646785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671029-a66c-4e27-bd69-cec87ee46e0d service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.712186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.713170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.713561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.713960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.715076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.718357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.759543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 948/1891] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:31 2022] POST /identity/v3/users => generated 297 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:31.770315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.781554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153ebc7-a160-4a5a-bd41-de3a2907eab0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.788577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.791756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.792364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.792668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.794357 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.797954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.813751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 944/1892] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:31.817615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.835561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6fbe8-6660-42ef-9e7d-375aea0e10f2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.842816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.844266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.844700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.845148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] PATH_INFO: `/v3/projects/b0d8498f89b74d49a797f7fe0f1075fa/users/a967e8decbaa4f86bf8e2e8ec870c9d7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.867268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d8498f89b74d49a797f7fe0f1075fa, user_id=a967e8decbaa4f86bf8e2e8ec870c9d7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.871329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:31.899793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 949/1893] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:31 2022] PUT /identity/v3/projects/b0d8498f89b74d49a797f7fe0f1075fa/users/a967e8decbaa4f86bf8e2e8ec870c9d7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:31.901501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:31.914231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1db7e-4a75-409d-8681-1cb92bca9c24 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:31.980792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5192f-3616-406f-b63c-02f6f82a5528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:31.981538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5192f-3616-406f-b63c-02f6f82a5528 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:31.981828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5192f-3616-406f-b63c-02f6f82a5528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:31.982122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5192f-3616-406f-b63c-02f6f82a5528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:31.983398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5192f-3616-406f-b63c-02f6f82a5528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:31.985092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5192f-3616-406f-b63c-02f6f82a5528 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:32.003927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 945/1894] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:32.008030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:32.020764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665e875-76be-4b0a-af8c-67c5b9290123 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:32.027005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:32.028256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:32.028696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:32.029269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] PATH_INFO: `/v3/projects/b0d8498f89b74d49a797f7fe0f1075fa/users/a967e8decbaa4f86bf8e2e8ec870c9d7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:32.033403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d8498f89b74d49a797f7fe0f1075fa, user_id=a967e8decbaa4f86bf8e2e8ec870c9d7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:32.036515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:32.048281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 950/1895] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:32 2022] PUT /identity/v3/projects/b0d8498f89b74d49a797f7fe0f1075fa/users/a967e8decbaa4f86bf8e2e8ec870c9d7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:32.058344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793b88-f5da-4686-a45c-d437311837fa None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:32.058642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793b88-f5da-4686-a45c-d437311837fa None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:32.058924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793b88-f5da-4686-a45c-d437311837fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:32.088323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-1e793b88-f5da-4686-a45c-d437311837fa None None] MFA Rules not processed for user `a967e8decbaa4f86bf8e2e8ec870c9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:32.089753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1e793b88-f5da-4686-a45c-d437311837fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:32.177820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 946/1896] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:32.238786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:32.240522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:32.301039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0585936-5019-4e73-aad9-3e5178d88bd6 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:32.305122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:32.305816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:32.306103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:32.306384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:32.316053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:32.317489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:32.327846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 951/1897] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:32.427837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793b88-f5da-4686-a45c-d437311837fa None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:32.437837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793b88-f5da-4686-a45c-d437311837fa None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:32.445423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ec79f-914c-4c1a-836d-1d7ed929e616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:32.446108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ec79f-914c-4c1a-836d-1d7ed929e616 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:32.446396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ec79f-914c-4c1a-836d-1d7ed929e616 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:32.446676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ec79f-914c-4c1a-836d-1d7ed929e616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:32.496336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:32.508796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ec79f-914c-4c1a-836d-1d7ed929e616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:32.510295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ec79f-914c-4c1a-836d-1d7ed929e616 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:32.519916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 947/1898] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:32.559469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504acf9-70b0-4b6e-9b0d-3519e889e46f service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:32.564664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:32.565518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:32.565846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:32.566220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] PATH_INFO: `/v3/users/c0a778828fcc4c26b7ba8822ed9bbc2b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:32.567404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a778828fcc4c26b7ba8822ed9bbc2b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:32.569348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:32.612922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a778828fcc4c26b7ba8822ed9bbc2b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:32.619723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a778828fcc4c26b7ba8822ed9bbc2b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:32.620448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a778828fcc4c26b7ba8822ed9bbc2b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:32.632618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a778828fcc4c26b7ba8822ed9bbc2b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:32.633266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a778828fcc4c26b7ba8822ed9bbc2b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:32.646762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 952/1899] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:32 2022] DELETE /identity/v3/users/c0a778828fcc4c26b7ba8822ed9bbc2b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:32.651822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:32.652110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:32.652385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:32.672048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:32.673586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:32.735251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 948/1900] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:32.746378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:32.748287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:32.836434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2efdc-d508-470e-896a-9ea8217efb51 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:32.840198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:32.840841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:32.841118 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:32.841519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:32.851529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:32.859897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:32.862789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 953/1901] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:33.153156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:33.155176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:33.167675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9e93e-9c0d-48d7-9f22-b158be65d66b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:33.172828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:33.173687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:33.174000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:33.174338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] PATH_INFO: `/v3/projects/85d9c5fb951c41ebb6d89808067443e8` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:33.175527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d9c5fb951c41ebb6d89808067443e8)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:33.177443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:33.224266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d9c5fb951c41ebb6d89808067443e8', 'request_id': 'req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.231616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d9c5fb951c41ebb6d89808067443e8', 'request_id': 'req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.238831 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d9c5fb951c41ebb6d89808067443e8', 'request_id': 'req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.250102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] The token cache is being invalidate because project 85d9c5fb951c41ebb6d89808067443e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:33.250396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.251074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.258072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 949/1902] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:33 2022] DELETE /identity/v3/projects/85d9c5fb951c41ebb6d89808067443e8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:33.258231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:33.268642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c073-31f5-4ba7-9a7e-8dc9fe622502 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:33.341339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:33.342311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:33.342597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:33.342874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] PATH_INFO: `/v3/users/7fd914ac5e35438499db5f68efe5826f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:33.344082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd914ac5e35438499db5f68efe5826f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:33.346054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:33.392911 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd914ac5e35438499db5f68efe5826f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.399682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd914ac5e35438499db5f68efe5826f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.400357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd914ac5e35438499db5f68efe5826f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.412099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd914ac5e35438499db5f68efe5826f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.412805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9df2a0cb-1887-4c5c-afcd-c5c806bccdb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd914ac5e35438499db5f68efe5826f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.425802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 954/1903] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:33 2022] DELETE /identity/v3/users/7fd914ac5e35438499db5f68efe5826f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:33.688330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:33.689888 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:33.702998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e657-53c6-421d-8cad-3ddda7ae6ca8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:33.764886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:33.765779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:33.766063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:33.766335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] PATH_INFO: `/v3/projects/fc3513fbfe9348e3a00166d8d9c246c1` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:33.767559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3513fbfe9348e3a00166d8d9c246c1)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:33.769686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:33.813240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3513fbfe9348e3a00166d8d9c246c1', 'request_id': 'req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.820494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3513fbfe9348e3a00166d8d9c246c1', 'request_id': 'req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.826909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3513fbfe9348e3a00166d8d9c246c1', 'request_id': 'req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.837533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] The token cache is being invalidate because project fc3513fbfe9348e3a00166d8d9c246c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:33.837852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.838486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b9a16ce-9df3-480c-83d3-bbb5bbeedb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:33.840274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 950/1904] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:33 2022] DELETE /identity/v3/projects/fc3513fbfe9348e3a00166d8d9c246c1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:33.845776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46b4d-49f5-4381-a19d-69c9ee45b0ca None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:33.846219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46b4d-49f5-4381-a19d-69c9ee45b0ca None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:33.846549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46b4d-49f5-4381-a19d-69c9ee45b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:33.865845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b2e46b4d-49f5-4381-a19d-69c9ee45b0ca None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:33.867099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b2e46b4d-49f5-4381-a19d-69c9ee45b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:33.928497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 955/1905] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:33.935807 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4673-f2eb-474b-b5f2-efffeb14d500 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:33.936090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4673-f2eb-474b-b5f2-efffeb14d500 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:33.936362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4673-f2eb-474b-b5f2-efffeb14d500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:33.954541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0c8b4673-f2eb-474b-b5f2-efffeb14d500 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:33.955747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0c8b4673-f2eb-474b-b5f2-efffeb14d500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:33.963627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 951/1906] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:33.968244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46b4d-49f5-4381-a19d-69c9ee45b0ca None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:33.977973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46b4d-49f5-4381-a19d-69c9ee45b0ca None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:33.983345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:33.984019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:33.984298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:33.984568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:33.985318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:33.985618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:33.987228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:33.998405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 956/1907] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:34.002537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b4673-f2eb-474b-b5f2-efffeb14d500 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.011617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b4673-f2eb-474b-b5f2-efffeb14d500 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.016811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.017478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.017802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.018086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.018781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.020690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.046191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 952/1908] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:34 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:34.050124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.059662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6da22-551e-4b94-bdb9-f1393501228b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.113886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.114483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.114763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.115035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.115721 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.117623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.140132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 957/1909] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:34 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:34.141554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.152791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fccf1-b9cd-4a6a-8788-8f153a83f8df admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.158063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.158745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.159026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.159297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.160017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.161608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.175492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 953/1910] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:34.177495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.188670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ee52-66fc-4610-9c64-a8890167daf4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.193317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8e9a8-811e-4f28-9e88-ca3a7e246068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.194640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e9a8-811e-4f28-9e88-ca3a7e246068 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.194992 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e9a8-811e-4f28-9e88-ca3a7e246068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.195335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e9a8-811e-4f28-9e88-ca3a7e246068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.196123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8e9a8-811e-4f28-9e88-ca3a7e246068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.197792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8e9a8-811e-4f28-9e88-ca3a7e246068 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.208222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 958/1911] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:34.212308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.222373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858d9ba-11e3-44e8-bced-a70bf5e85e85 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.226985 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.227990 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.228267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.228538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] PATH_INFO: `/v3/projects/c1425269db2445db96d0fbcd2dcafb75/users/9c09362fa6c14e4ba8fcaa66fb8b764b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.245649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1425269db2445db96d0fbcd2dcafb75, user_id=9c09362fa6c14e4ba8fcaa66fb8b764b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.249648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.266176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 954/1912] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:34 2022] PUT /identity/v3/projects/c1425269db2445db96d0fbcd2dcafb75/users/9c09362fa6c14e4ba8fcaa66fb8b764b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:34.278959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c84e-8fd6-4642-8816-49acce2299d2 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.279426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c84e-8fd6-4642-8816-49acce2299d2 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.279592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c84e-8fd6-4642-8816-49acce2299d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.307832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4410c84e-8fd6-4642-8816-49acce2299d2 None None] MFA Rules not processed for user `9c09362fa6c14e4ba8fcaa66fb8b764b`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:34.309035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4410c84e-8fd6-4642-8816-49acce2299d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:34.375087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 959/1913] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:34.379791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.446084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4de59-a3fc-4498-b496-d99bd2a95095 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.455341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.456163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.456954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.457242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.458129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.460681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.490160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 955/1914] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:34 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:34.494697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410c84e-8fd6-4642-8816-49acce2299d2 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.505523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410c84e-8fd6-4642-8816-49acce2299d2 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.567542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.568228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.568569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.569137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.570466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.572353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.602501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 960/1915] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:34 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:34.606496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.617452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cee98-036e-4cdd-a602-d0e0c748f6c4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.622528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.622929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.623256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.623538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.624267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.625908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.637411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 956/1916] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:34.641394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.651664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652686-1e85-4e0f-b169-22cc90d56e21 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.657061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.658040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.658321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.658593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] PATH_INFO: `/v3/projects/1868da96ae6b48a483c27c6288a41b16/users/ca4863c070eb401680d6dde9e42f2990/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.673539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1868da96ae6b48a483c27c6288a41b16, user_id=ca4863c070eb401680d6dde9e42f2990, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.676313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.688981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 961/1917] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:34 2022] PUT /identity/v3/projects/1868da96ae6b48a483c27c6288a41b16/users/ca4863c070eb401680d6dde9e42f2990/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:34.692902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.702952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae778-20d9-4a57-8d5d-bd9749edb49c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.757429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04726-d92e-46f5-a0ca-a702dd9688d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.758114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04726-d92e-46f5-a0ca-a702dd9688d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.758401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04726-d92e-46f5-a0ca-a702dd9688d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.758677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04726-d92e-46f5-a0ca-a702dd9688d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.759397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c04726-d92e-46f5-a0ca-a702dd9688d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.761157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c04726-d92e-46f5-a0ca-a702dd9688d5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.771378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 957/1918] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:34.775421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.785987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c641-4e52-4212-980e-cb38cbb7ba51 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.790478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.791338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.791617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.791890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] PATH_INFO: `/v3/projects/1868da96ae6b48a483c27c6288a41b16/users/ca4863c070eb401680d6dde9e42f2990/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.793871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1868da96ae6b48a483c27c6288a41b16, user_id=ca4863c070eb401680d6dde9e42f2990, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:34.796477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:34.806157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 962/1919] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:34 2022] PUT /identity/v3/projects/1868da96ae6b48a483c27c6288a41b16/users/ca4863c070eb401680d6dde9e42f2990/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:34.815814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9561a-8876-490e-8921-dbb2ad4b4af5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.816098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9561a-8876-490e-8921-dbb2ad4b4af5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.816369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9561a-8876-490e-8921-dbb2ad4b4af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.842820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f7f9561a-8876-490e-8921-dbb2ad4b4af5 None None] MFA Rules not processed for user `ca4863c070eb401680d6dde9e42f2990`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:34.844026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f7f9561a-8876-490e-8921-dbb2ad4b4af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:34.912277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 958/1920] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:34.923717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:34.925396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:34.984360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d914-0acc-4713-aa15-4649af154c8a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:34.989062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5c95c-fc6f-4712-bad0-69049c25e414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:34.989779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5c95c-fc6f-4712-bad0-69049c25e414 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:34.990271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5c95c-fc6f-4712-bad0-69049c25e414 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:34.990356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5c95c-fc6f-4712-bad0-69049c25e414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:34.999754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5c95c-fc6f-4712-bad0-69049c25e414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:35.001174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5c95c-fc6f-4712-bad0-69049c25e414 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:35.010881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 963/1921] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:35.471597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9561a-8876-490e-8921-dbb2ad4b4af5 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:35.563962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9561a-8876-490e-8921-dbb2ad4b4af5 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:35.581284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:35.582697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:35.583126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:35.583543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] PATH_INFO: `/v3/users/9c09362fa6c14e4ba8fcaa66fb8b764b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:35.585326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c09362fa6c14e4ba8fcaa66fb8b764b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:35.587672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:35.665562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c09362fa6c14e4ba8fcaa66fb8b764b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:35.688337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c09362fa6c14e4ba8fcaa66fb8b764b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:35.694184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c09362fa6c14e4ba8fcaa66fb8b764b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:35.715208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c09362fa6c14e4ba8fcaa66fb8b764b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:35.716129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c09362fa6c14e4ba8fcaa66fb8b764b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:35.737227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:35.738997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:35.739832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:35.741379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 959/1922] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:35 2022] DELETE /identity/v3/users/9c09362fa6c14e4ba8fcaa66fb8b764b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:35.761081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:35.762699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:35.839940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 964/1923] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:35.855934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:35.859129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:35.991156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f00984-dc75-4e94-b6c1-645efa5de467 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:36.001787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:36.002618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:36.003019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:36.003469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:36.019008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:36.020482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:36.051756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 960/1924] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:36.528461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:36.530097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:36.546718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfb877-a76a-441e-8fbe-ce0c1cc2153e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:36.555900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:36.557254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:36.557667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:36.558273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] PATH_INFO: `/v3/projects/c1425269db2445db96d0fbcd2dcafb75` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:36.559874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1425269db2445db96d0fbcd2dcafb75)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:36.565765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:36.637001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:36.639550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:36.666009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d2da-f908-4e66-ac3d-10050fb6499d service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:36.678343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1425269db2445db96d0fbcd2dcafb75', 'request_id': 'req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.699343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1425269db2445db96d0fbcd2dcafb75', 'request_id': 'req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.708049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1425269db2445db96d0fbcd2dcafb75', 'request_id': 'req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.737508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] The token cache is being invalidate because project c1425269db2445db96d0fbcd2dcafb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:36.739411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.741082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.746841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 965/1925] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:36 2022] DELETE /identity/v3/projects/c1425269db2445db96d0fbcd2dcafb75 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:36.753856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:36.755555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:36.778526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:36.782025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:36.782402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:36.782694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] PATH_INFO: `/v3/users/71d2c5d6537c4a128c38bf60c60824ef` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:36.785216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d2c5d6537c4a128c38bf60c60824ef)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:36.791128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:36.799160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c9d4a-c974-49b1-8775-5f83b0ad3705 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:36.814853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:36.815946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:36.816618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:36.817203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] PATH_INFO: `/v3/users/ca4863c070eb401680d6dde9e42f2990` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:36.818751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4863c070eb401680d6dde9e42f2990)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:36.831256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:36.908000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4863c070eb401680d6dde9e42f2990'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.917490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d2c5d6537c4a128c38bf60c60824ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.946164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4863c070eb401680d6dde9e42f2990'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.953511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4863c070eb401680d6dde9e42f2990'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.956986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d2c5d6537c4a128c38bf60c60824ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.958345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d2c5d6537c4a128c38bf60c60824ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.983709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4863c070eb401680d6dde9e42f2990'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.985804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4863c070eb401680d6dde9e42f2990'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.989610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d2c5d6537c4a128c38bf60c60824ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:36.991596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4a6dbbc0-2741-481c-b56b-184d53973d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d2c5d6537c4a128c38bf60c60824ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.017189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 961/1926] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:36 2022] DELETE /identity/v3/users/71d2c5d6537c4a128c38bf60c60824ef => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:37.024745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.024981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.025323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.029317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 966/1927] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:36 2022] DELETE /identity/v3/users/ca4863c070eb401680d6dde9e42f2990 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:37.059091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:37.061455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.091377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:37.095457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.208235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 962/1928] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:37.214848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:37.216918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.221187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9ddd1-84a8-4a60-b355-cee0eb51ca48 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:37.226373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:37.227558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.228177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.228636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] PATH_INFO: `/v3/users/cffc379c42ab48fcb8d46dc770c788d5` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.229995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffc379c42ab48fcb8d46dc770c788d5)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:37.232021 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:37.288332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffc379c42ab48fcb8d46dc770c788d5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.292295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7e8ee-ac83-43a7-8545-087a5782b931 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:37.295566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809870b-0394-4d53-a8ff-0897bb25dc3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:37.296444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809870b-0394-4d53-a8ff-0897bb25dc3a service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.296886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809870b-0394-4d53-a8ff-0897bb25dc3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.297165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809870b-0394-4d53-a8ff-0897bb25dc3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.297362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffc379c42ab48fcb8d46dc770c788d5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.298207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffc379c42ab48fcb8d46dc770c788d5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.299648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1809870b-0394-4d53-a8ff-0897bb25dc3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.314622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809870b-0394-4d53-a8ff-0897bb25dc3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:37.316094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809870b-0394-4d53-a8ff-0897bb25dc3a service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:37.317391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffc379c42ab48fcb8d46dc770c788d5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.318367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffc379c42ab48fcb8d46dc770c788d5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.328406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 963/1929] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:37.336263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 967/1930] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:37 2022] DELETE /identity/v3/users/cffc379c42ab48fcb8d46dc770c788d5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:37.340607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.340933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.341211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.362092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:37.363525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.374959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:37.376421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.455748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 964/1931] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:37.471939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f3e2e-6406-4812-bf51-f7dec17a247c admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:37.475586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:37.477104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.482150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:37.484339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.484584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.484856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] PATH_INFO: `/v3/users/1a0e91753caf4d68bcf481e7934cec0a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.486180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0e91753caf4d68bcf481e7934cec0a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:37.488676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:37.583575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0e91753caf4d68bcf481e7934cec0a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.585574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ad14-9d11-40a9-ba3f-4994663060a3 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:37.590032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:37.591023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.591023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.591238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.595846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0e91753caf4d68bcf481e7934cec0a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.597091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0e91753caf4d68bcf481e7934cec0a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.603975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:37.605468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:37.614250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0e91753caf4d68bcf481e7934cec0a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.615156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-aec41c12-ddda-4371-a651-bd9b9e84eb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0e91753caf4d68bcf481e7934cec0a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.617395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 965/1932] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:37.618327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:37.620392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.636646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6824c6-3a75-436a-924d-2b08bc5efeaf service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:37.649131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:37.650161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.650599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.651249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] PATH_INFO: `/v3/projects/1868da96ae6b48a483c27c6288a41b16` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.651375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 968/1933] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:37 2022] DELETE /identity/v3/users/1a0e91753caf4d68bcf481e7934cec0a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:37.655209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1868da96ae6b48a483c27c6288a41b16)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:37.657063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.657370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.657925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.658883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:37.694274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:37.697824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.718172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1868da96ae6b48a483c27c6288a41b16', 'request_id': 'req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.731184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1868da96ae6b48a483c27c6288a41b16', 'request_id': 'req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.743089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1868da96ae6b48a483c27c6288a41b16', 'request_id': 'req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.759558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] The token cache is being invalidate because project 1868da96ae6b48a483c27c6288a41b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:37.759558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.760307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-c2f790eb-0e83-40f3-96d2-bcc39d5b6ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:37.763012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 966/1934] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:37 2022] DELETE /identity/v3/projects/1868da96ae6b48a483c27c6288a41b16 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:37.768743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.769314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.769868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.798599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:37.800013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.846439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 969/1935] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:37.846439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:37.851462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.870227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256198b-f438-418e-85e3-eb0b1fef564a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:37.878332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:37.879512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:37.879998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:37.880474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] PATH_INFO: `/v3/projects/ab30135321524961a1a39d7c64246d74` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:37.882567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab30135321524961a1a39d7c64246d74)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:37.884717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:37.985239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 967/1936] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:37.986604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:37.987937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:37.991525 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab30135321524961a1a39d7c64246d74', 'request_id': 'req-63c410e5-9f45-4ab6-816a-dbd765e091bf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.018090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab30135321524961a1a39d7c64246d74', 'request_id': 'req-63c410e5-9f45-4ab6-816a-dbd765e091bf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.024989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab30135321524961a1a39d7c64246d74', 'request_id': 'req-63c410e5-9f45-4ab6-816a-dbd765e091bf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.054582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] The token cache is being invalidate because project ab30135321524961a1a39d7c64246d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:38.054891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.055557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-63c410e5-9f45-4ab6-816a-dbd765e091bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.057172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 970/1937] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:37 2022] DELETE /identity/v3/projects/ab30135321524961a1a39d7c64246d74 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:38.060243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17076-43a8-461a-94fe-519953e27686 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.060243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17076-43a8-461a-94fe-519953e27686 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.060243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17076-43a8-461a-94fe-519953e27686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.075881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da831341-bb71-45c1-83b5-af31b8a53671 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.094511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-eee17076-43a8-461a-94fe-519953e27686 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:38.096214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-eee17076-43a8-461a-94fe-519953e27686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.146176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.147169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.147169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.147464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.149448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.189024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 971/1938] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:38.190207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17076-43a8-461a-94fe-519953e27686 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.191864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-eee17076-43a8-461a-94fe-519953e27686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.207655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17076-43a8-461a-94fe-519953e27686 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.217833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.223783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.224091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.224439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] PATH_INFO: `/v3/users/ff4099f0a66244a08c7614afb6a929ab` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.227621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4099f0a66244a08c7614afb6a929ab)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.229474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.283968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.285605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.297417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 968/1939] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:38.298154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.310295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d86682-c320-4498-a84c-c01aa61f3d41 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.316228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.316921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.317192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.317464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.318236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:38.318548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.320321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.324201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4099f0a66244a08c7614afb6a929ab'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.334221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4099f0a66244a08c7614afb6a929ab'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.335103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4099f0a66244a08c7614afb6a929ab'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.335926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 969/1940] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:38.338854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.341132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.351803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4099f0a66244a08c7614afb6a929ab'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.353623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4099f0a66244a08c7614afb6a929ab'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.355001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921a157-cc54-4f6a-a316-b3133f493d41 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.361805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.362758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.363285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.363661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] PATH_INFO: `/v3/projects/03d06270fed4485ea61225f27d0a8819` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.371438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d06270fed4485ea61225f27d0a8819)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.374342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.377584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 972/1941] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:38 2022] DELETE /identity/v3/users/ff4099f0a66244a08c7614afb6a929ab => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:38.379464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.379858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.437118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d06270fed4485ea61225f27d0a8819', 'request_id': 'req-e3857b50-b927-4356-a861-3018ff00e98a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.454601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d06270fed4485ea61225f27d0a8819', 'request_id': 'req-e3857b50-b927-4356-a861-3018ff00e98a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.463563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d06270fed4485ea61225f27d0a8819', 'request_id': 'req-e3857b50-b927-4356-a861-3018ff00e98a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.468419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad8f17-0343-418d-a461-347cd8ecf660 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.475444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] The token cache is being invalidate because project 03d06270fed4485ea61225f27d0a8819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:38.475743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.476418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.478837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 970/1942] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:38 2022] DELETE /identity/v3/projects/03d06270fed4485ea61225f27d0a8819 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:38.483670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.486382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.537336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.538522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.539953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.539953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.539953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.542611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.600510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3857b50-b927-4356-a861-3018ff00e98a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.608214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 973/1943] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:38 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:38.612848 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.613465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.616937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.625828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.626248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.628202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] PATH_INFO: `/v3/users/71a344464c794d509407958525061059` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.632212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a344464c794d509407958525061059)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.636484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.697415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a344464c794d509407958525061059'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.708789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a344464c794d509407958525061059'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.709984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a344464c794d509407958525061059'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.714578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bf04c-9641-4035-8f11-f36fd2d6d555 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.721765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.722518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.722810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.723166 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.724023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.726772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.743385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a344464c794d509407958525061059'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.744247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a344464c794d509407958525061059'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.750715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 974/1944] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:38 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:38.751651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.757141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.762882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 971/1945] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:38 2022] DELETE /identity/v3/users/71a344464c794d509407958525061059 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:38.764393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.766131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.776524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da4cc5-60ad-42e7-96ab-f0851ce90d5b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.843944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.844922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.845401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.845874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] PATH_INFO: `/v3/projects/08921ebf060447db9ea8618d0c795b19` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.847347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=08921ebf060447db9ea8618d0c795b19)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.850277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.856488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcdcd7-8f24-4eda-8b60-9226e4cb2686 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.862211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.862886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.863292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.863490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.864182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.865967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.878236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 972/1946] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:38.878236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.878737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.892756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f56698-3048-49df-9dc0-bef531778fa9 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:38.897792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:38.898480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:38.898787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:38.899076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] PATH_INFO: `/v3/projects/f7c1fff0e0c349fa822d8c53abfed278` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:38.900541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c1fff0e0c349fa822d8c53abfed278)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:38.902286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:38.910449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08921ebf060447db9ea8618d0c795b19', 'request_id': 'req-618ab278-3d00-4af1-a456-02816d0ac22f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.919081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08921ebf060447db9ea8618d0c795b19', 'request_id': 'req-618ab278-3d00-4af1-a456-02816d0ac22f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.925928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08921ebf060447db9ea8618d0c795b19', 'request_id': 'req-618ab278-3d00-4af1-a456-02816d0ac22f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.937558 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] The token cache is being invalidate because project 08921ebf060447db9ea8618d0c795b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:38.937998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.938649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.943585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 975/1947] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:38 2022] DELETE /identity/v3/projects/08921ebf060447db9ea8618d0c795b19 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:38.944648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:38.946129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:38.964808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c1fff0e0c349fa822d8c53abfed278', 'request_id': 'req-d60d04ce-d9f4-403a-be3d-11f4b03599ea'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.974276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c1fff0e0c349fa822d8c53abfed278', 'request_id': 'req-d60d04ce-d9f4-403a-be3d-11f4b03599ea'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.983410 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c1fff0e0c349fa822d8c53abfed278', 'request_id': 'req-d60d04ce-d9f4-403a-be3d-11f4b03599ea'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.997853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] The token cache is being invalidate because project f7c1fff0e0c349fa822d8c53abfed278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:38.998518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:38.999260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.003677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 973/1948] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:38 2022] DELETE /identity/v3/projects/f7c1fff0e0c349fa822d8c53abfed278 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:39.003677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:39.005024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.035032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ab278-3d00-4af1-a456-02816d0ac22f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.082385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d04ce-d9f4-403a-be3d-11f4b03599ea admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.088108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.089172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.089632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.089999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] PATH_INFO: `/v3/users/a967e8decbaa4f86bf8e2e8ec870c9d7` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.091434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a967e8decbaa4f86bf8e2e8ec870c9d7)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.094142 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:39.103141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.103839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.104127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.104398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.105130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.106785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:39.121922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 976/1949] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:39.121922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:39.121922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.135263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f60e-ec4f-44f8-b1ff-35c95c383de0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.140619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.141818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.142208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.142564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] PATH_INFO: `/v3/users/80219377e3e94e429be53ac700b11e21` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.144041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80219377e3e94e429be53ac700b11e21)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.146673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:39.171758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a967e8decbaa4f86bf8e2e8ec870c9d7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.180570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a967e8decbaa4f86bf8e2e8ec870c9d7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.181255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a967e8decbaa4f86bf8e2e8ec870c9d7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.194038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a967e8decbaa4f86bf8e2e8ec870c9d7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.194891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a967e8decbaa4f86bf8e2e8ec870c9d7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.197227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80219377e3e94e429be53ac700b11e21'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.212283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80219377e3e94e429be53ac700b11e21'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.213081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80219377e3e94e429be53ac700b11e21'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.217647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 974/1950] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:39 2022] DELETE /identity/v3/users/a967e8decbaa4f86bf8e2e8ec870c9d7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:39.217647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:39.217647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.238182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80219377e3e94e429be53ac700b11e21'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.239719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80219377e3e94e429be53ac700b11e21'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.259384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 977/1951] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:39 2022] DELETE /identity/v3/users/80219377e3e94e429be53ac700b11e21 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:39.260576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:39.277530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.350081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e6ee7-a475-4b46-8fcc-bf9dfb953d6b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.425533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127a1f1-a3e3-4a63-8810-fcb852d5c16a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.440501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.441633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.441826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.441985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] PATH_INFO: `/v3/projects/3b9c33e3ea1e4597864659adec24b7f1/users/ac18c8a4b8d640d5a0daf98328a3135d/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.470850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9c33e3ea1e4597864659adec24b7f1, user_id=ac18c8a4b8d640d5a0daf98328a3135d, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.472382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.473462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.474234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.474341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:39.474889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] PATH_INFO: `/v3/projects/32aafb6ad99e452cadc80cc2b78f01f5` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.476476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32aafb6ad99e452cadc80cc2b78f01f5)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.480373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:39.504130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 978/1952] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:39 2022] PUT /identity/v3/projects/3b9c33e3ea1e4597864659adec24b7f1/users/ac18c8a4b8d640d5a0daf98328a3135d/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:39.504130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:39.507330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.601209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32aafb6ad99e452cadc80cc2b78f01f5', 'request_id': 'req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.619105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32aafb6ad99e452cadc80cc2b78f01f5', 'request_id': 'req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.629042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32aafb6ad99e452cadc80cc2b78f01f5', 'request_id': 'req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.641792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] The token cache is being invalidate because project 32aafb6ad99e452cadc80cc2b78f01f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:39.642085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.642870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ea0aa5b-8c93-45d5-aad8-6f01185a6774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.644531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 975/1953] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:39 2022] DELETE /identity/v3/projects/32aafb6ad99e452cadc80cc2b78f01f5 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:39.645268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e3fa-c169-47e0-a417-32309f6b7bcc admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.645845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0a66-74e2-403b-9fe1-a9cc69211f2a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.646286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0a66-74e2-403b-9fe1-a9cc69211f2a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.646876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0a66-74e2-403b-9fe1-a9cc69211f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.714815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.715861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.716145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.716421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] PATH_INFO: `/v3/users/eb5e2f5db3634d8aa5bc633d496c5810` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.717864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5e2f5db3634d8aa5bc633d496c5810)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.719903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:39.721072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a45d0a66-74e2-403b-9fe1-a9cc69211f2a None None] MFA Rules not processed for user `ac18c8a4b8d640d5a0daf98328a3135d`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:39.722536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a45d0a66-74e2-403b-9fe1-a9cc69211f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.808356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5e2f5db3634d8aa5bc633d496c5810'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.818878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5e2f5db3634d8aa5bc633d496c5810'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.819679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5e2f5db3634d8aa5bc633d496c5810'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.832724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 976/1954] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:39.834414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.834802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.834979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.836961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5e2f5db3634d8aa5bc633d496c5810'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.837831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5e2f5db3634d8aa5bc633d496c5810'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:39.854560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 979/1955] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:39 2022] DELETE /identity/v3/users/eb5e2f5db3634d8aa5bc633d496c5810 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:39.856581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:39.857543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:39.858356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.859119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.940280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 977/1956] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:39.941174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:39.942579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:39.968581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79065-356d-46b8-aaaf-1b505c1fd6c5 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.973108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b23b6-839b-482a-a39f-624ffa284c78 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:39.979605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.979817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d7a51-e690-41a7-b71e-71df46b40922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:39.980587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7a51-e690-41a7-b71e-71df46b40922 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.980881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7a51-e690-41a7-b71e-71df46b40922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.981147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:39.981258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7a51-e690-41a7-b71e-71df46b40922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.981867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:39.982188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d7a51-e690-41a7-b71e-71df46b40922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.983563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] PATH_INFO: `/v3/projects/b0d8498f89b74d49a797f7fe0f1075fa` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:39.985035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d8498f89b74d49a797f7fe0f1075fa)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:39.987095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d7a51-e690-41a7-b71e-71df46b40922 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:39.987619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.025209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 978/1957] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:39 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:40.026971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7835-d618-453a-912e-b19fcc394759 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.027406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7835-d618-453a-912e-b19fcc394759 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.027885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7835-d618-453a-912e-b19fcc394759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.050761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f75e7835-d618-453a-912e-b19fcc394759 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:40.052104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f75e7835-d618-453a-912e-b19fcc394759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.056032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d8498f89b74d49a797f7fe0f1075fa', 'request_id': 'req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.066011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d8498f89b74d49a797f7fe0f1075fa', 'request_id': 'req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.079415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d8498f89b74d49a797f7fe0f1075fa', 'request_id': 'req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.093826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] The token cache is being invalidate because project b0d8498f89b74d49a797f7fe0f1075fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:40.094164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.094781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.099498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 980/1958] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:39 2022] DELETE /identity/v3/projects/b0d8498f89b74d49a797f7fe0f1075fa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:40.099498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.099498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.128782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 979/1959] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:40.128782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.128782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.128782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.147800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:40.149034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.157502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 980/1960] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:40.158446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.161765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.170792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabaf3e-79c2-44bb-b7f9-f73477a40f71 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.173905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4039d57-7aa4-4359-9bb0-9915ca73d892 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.175774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.176624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.176901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.177167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] PATH_INFO: `/v3/projects/471f6c554d21447690b0ad55e63a0a65` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.178353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=471f6c554d21447690b0ad55e63a0a65)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.179414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d9ae2-f7fa-46b7-b5c6-935ad6747240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.180104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d9ae2-f7fa-46b7-b5c6-935ad6747240 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.180244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.180478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d9ae2-f7fa-46b7-b5c6-935ad6747240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.180668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d9ae2-f7fa-46b7-b5c6-935ad6747240 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.181358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d9ae2-f7fa-46b7-b5c6-935ad6747240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.183417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d9ae2-f7fa-46b7-b5c6-935ad6747240 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.204187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 981/1961] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:40.206069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.206536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.206816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.228621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:40.229885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.231825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471f6c554d21447690b0ad55e63a0a65', 'request_id': 'req-f333ad4e-78e9-4d21-a442-3740184cc87f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.239509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471f6c554d21447690b0ad55e63a0a65', 'request_id': 'req-f333ad4e-78e9-4d21-a442-3740184cc87f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.246695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471f6c554d21447690b0ad55e63a0a65', 'request_id': 'req-f333ad4e-78e9-4d21-a442-3740184cc87f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.257423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] The token cache is being invalidate because project 471f6c554d21447690b0ad55e63a0a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:40.257729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.258430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.260038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 981/1962] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:40 2022] DELETE /identity/v3/projects/471f6c554d21447690b0ad55e63a0a65 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:40.260867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.262245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.290844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 982/1963] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:40.291968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.293375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.304287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2a79-a281-4cc3-9814-93d7fb30ece8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.308889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.309530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.309845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.310122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.310838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:40.311141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.312732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.319506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333ad4e-78e9-4d21-a442-3740184cc87f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.323214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79e0ab-8069-483d-8e61-180bc332aaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.324136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e0ab-8069-483d-8e61-180bc332aaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.324244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 983/1964] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:40.324321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e0ab-8069-483d-8e61-180bc332aaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.324468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e0ab-8069-483d-8e61-180bc332aaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.324713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.326892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7a79e0ab-8069-483d-8e61-180bc332aaa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.329248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.339772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79e0ab-8069-483d-8e61-180bc332aaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.341121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a9803-9915-4d8a-a907-a768fa24c066 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.341234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79e0ab-8069-483d-8e61-180bc332aaa1 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.346258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb0d6e-a76c-48d1-8bff-c6c9f9da8080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.347028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb0d6e-a76c-48d1-8bff-c6c9f9da8080 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.347312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb0d6e-a76c-48d1-8bff-c6c9f9da8080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.347587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb0d6e-a76c-48d1-8bff-c6c9f9da8080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.348292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb0d6e-a76c-48d1-8bff-c6c9f9da8080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.349872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb0d6e-a76c-48d1-8bff-c6c9f9da8080 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.351276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 982/1965] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:40.352569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32558b1-aa22-4300-b68a-27b8c5494f33 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.352860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32558b1-aa22-4300-b68a-27b8c5494f33 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.353136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32558b1-aa22-4300-b68a-27b8c5494f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.360656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 984/1966] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:40.361587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6cbad-3bdd-4023-bcab-12175e705120 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.361899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6cbad-3bdd-4023-bcab-12175e705120 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.362174 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6cbad-3bdd-4023-bcab-12175e705120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.373258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e32558b1-aa22-4300-b68a-27b8c5494f33 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:40.374512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e32558b1-aa22-4300-b68a-27b8c5494f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.383441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-75a6cbad-3bdd-4023-bcab-12175e705120 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:40.384635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-75a6cbad-3bdd-4023-bcab-12175e705120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.393837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 983/1967] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:40.394687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32558b1-aa22-4300-b68a-27b8c5494f33 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.408905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 985/1968] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:40.409817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6cbad-3bdd-4023-bcab-12175e705120 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.420963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6cbad-3bdd-4023-bcab-12175e705120 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.422018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32558b1-aa22-4300-b68a-27b8c5494f33 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.437800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.438964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.439303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.439417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af6209-61b3-4e89-a1ac-17b372e1ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.439613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] PATH_INFO: `/v3/projects/fb686cb177a744a89b6646e3e7bd6d28/users/1b3e696042df46ee94a75e7baa03aeb7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.440029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6209-61b3-4e89-a1ac-17b372e1ce10 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.440314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6209-61b3-4e89-a1ac-17b372e1ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.440593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6209-61b3-4e89-a1ac-17b372e1ce10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.441346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af6209-61b3-4e89-a1ac-17b372e1ce10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.443382 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af6209-61b3-4e89-a1ac-17b372e1ce10 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.458582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb686cb177a744a89b6646e3e7bd6d28, user_id=1b3e696042df46ee94a75e7baa03aeb7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.462041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.477476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 984/1969] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:40.477825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 986/1970] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:40 2022] PUT /identity/v3/projects/fb686cb177a744a89b6646e3e7bd6d28/users/1b3e696042df46ee94a75e7baa03aeb7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:40.478684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.479265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc01f-f53c-46be-9e77-e142e14aa764 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.479703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc01f-f53c-46be-9e77-e142e14aa764 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.480044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc01f-f53c-46be-9e77-e142e14aa764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.497245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0a8bc01f-f53c-46be-9e77-e142e14aa764 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:40.499171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0a8bc01f-f53c-46be-9e77-e142e14aa764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.551099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fc080-ec9e-4631-be9a-f01ca071e482 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.574531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 985/1971] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:40.574531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc01f-f53c-46be-9e77-e142e14aa764 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.589108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc01f-f53c-46be-9e77-e142e14aa764 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.596848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.597522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.597833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.598407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.599083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.601644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.623715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.624785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.625246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.625772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.626808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:40.627262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.629180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.633961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 986/1972] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:40.634903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.646100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 987/1973] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:40.647624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.652266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cf2e0-6948-4bd3-b7fd-758efc2205e4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.659097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671e9de-729a-41f9-9e95-f3e5b96c9a4e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.659275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.659809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.660515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.660801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.661542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.663676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.665589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.666669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.666994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.667245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.667968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:40.668703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.670509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.685053 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 988/1974] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:40.687691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 987/1975] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:40.688859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.690304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.702767 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7d3a6-f237-43b1-b582-487568d18b9b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.706414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e430e0-3d27-4be2-b285-9b883bc6e912 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.708084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.709053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.709224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.709651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.710418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.712084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.715205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.716038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.716325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.716639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.717336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.719404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.726432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 988/1976] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:40.726432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.727674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.741529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006721-4c33-4cc3-b420-79c02a4993a0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.746268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 989/1977] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:40.746726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.747340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.749001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.749294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.749575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] PATH_INFO: `/v3/projects/e57de30ceabb4bcb9d7cc1d27fe77306` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.750927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57de30ceabb4bcb9d7cc1d27fe77306)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.752842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.802826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57de30ceabb4bcb9d7cc1d27fe77306', 'request_id': 'req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.813078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57de30ceabb4bcb9d7cc1d27fe77306', 'request_id': 'req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.818815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1955-2f5e-438f-ae4f-cc9e1a8eabbf admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.820712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57de30ceabb4bcb9d7cc1d27fe77306', 'request_id': 'req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.831969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] The token cache is being invalidate because project e57de30ceabb4bcb9d7cc1d27fe77306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:40.832289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.832948 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:40.837391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 989/1978] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:40 2022] DELETE /identity/v3/projects/e57de30ceabb4bcb9d7cc1d27fe77306 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:40.837391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.838731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.880319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.881112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.881399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.881673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.882390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.884310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.910258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2d852-c123-45c2-bb08-4dd3de7fdbfd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:40.914611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 990/1979] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:40.915485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.917904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:40.918604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.918824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:40.919302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:40.919407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] PATH_INFO: `/v3/projects/fb686cb177a744a89b6646e3e7bd6d28/users/1b3e696042df46ee94a75e7baa03aeb7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:40.922581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb686cb177a744a89b6646e3e7bd6d28, user_id=1b3e696042df46ee94a75e7baa03aeb7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:40.925476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:40.946140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 990/1980] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:40 2022] PUT /identity/v3/projects/fb686cb177a744a89b6646e3e7bd6d28/users/1b3e696042df46ee94a75e7baa03aeb7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:40.946140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:40.948056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:40.988701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e017-106b-4cde-b154-c5fd04299c77 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.020060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762dad3-59cd-4b61-b566-51fd7ee4f9b9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.024805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.025468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.025797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.026072 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.026763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.028695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.043895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.045272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.045656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.046062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.046930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.048615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.049219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 991/1981] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:40 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:41.052458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.054117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.058802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 991/1982] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:41.059470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.061630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.066856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082cc3-fceb-4710-b1b9-343845ec3173 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.071524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.072401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.072664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.072941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] PATH_INFO: `/v3/users/308730a70988454d82565cf1245b6f76` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.073328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641a72b-3d44-45bf-a00e-b61877ab1bb3 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.074174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308730a70988454d82565cf1245b6f76)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.076102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.078999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed47a2-c868-496b-88db-9711f761f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.079627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed47a2-c868-496b-88db-9711f761f380 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.079914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed47a2-c868-496b-88db-9711f761f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.080191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed47a2-c868-496b-88db-9711f761f380 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.080874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed47a2-c868-496b-88db-9711f761f380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.082795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed47a2-c868-496b-88db-9711f761f380 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.103164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 992/1983] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:41 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:41.104361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.104692 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.104938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.124416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308730a70988454d82565cf1245b6f76'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.131086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308730a70988454d82565cf1245b6f76'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.131703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] MFA Rules not processed for user `1b3e696042df46ee94a75e7baa03aeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:41.131833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308730a70988454d82565cf1245b6f76'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.132936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.143247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308730a70988454d82565cf1245b6f76'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.143912 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308730a70988454d82565cf1245b6f76'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.157516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 992/1984] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:41 2022] DELETE /identity/v3/users/308730a70988454d82565cf1245b6f76 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:41.158367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.159731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.208978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 993/1985] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:41.210546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.212587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.229226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242d9f0-c90c-46b6-9f57-885087782720 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.236430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.237467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.237789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.238128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] PATH_INFO: `/v3/projects/a73f008ce2c14f66b0a8e934c8e91330/users/ddc3549898e64aa587beb5ec25ebd98d/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.241946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c0b19-dfc3-49d4-8d86-eb1c38a10d60 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.247071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.247778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.248054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.248439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.249245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.250896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.256540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73f008ce2c14f66b0a8e934c8e91330, user_id=ddc3549898e64aa587beb5ec25ebd98d, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.259410 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.262412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 993/1986] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:41.266582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.268498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.275569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 994/1987] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:41 2022] PUT /identity/v3/projects/a73f008ce2c14f66b0a8e934c8e91330/users/ddc3549898e64aa587beb5ec25ebd98d/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:41.276537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.278139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.288498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b453505-de3a-43ba-960e-e8d207563efd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.352325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.352998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.353281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.353543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.354386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.356018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.358275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6178-5662-444e-a9a8-e9dcbf4a707c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.362093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.362815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.363173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.363520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.367054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 994/1988] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:41.368094 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.379748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9dac1-b0ad-4e2f-8432-3e8bc673f26e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.384692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d9854-163f-4a45-bbe7-6298b906a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.385356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9854-163f-4a45-bbe7-6298b906a380 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.385641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9854-163f-4a45-bbe7-6298b906a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.385940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9854-163f-4a45-bbe7-6298b906a380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.386660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d9854-163f-4a45-bbe7-6298b906a380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.388447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d9854-163f-4a45-bbe7-6298b906a380 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.399350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 995/1989] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:41.404578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.404894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.405174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.437169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] MFA Rules not processed for user `ddc3549898e64aa587beb5ec25ebd98d`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:41.438052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.445016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.446580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.473354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 995/1990] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:41.474298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.486642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc5ba-e996-46bd-97d1-2028d32f1f10 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.491498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.492156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.492437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.492815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.493433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.495086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.514178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 996/1991] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:41.519061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.529650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4cf0-da27-48b6-a51b-97bdc03aa2fc admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.535271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.536402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.536692 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.537003 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] PATH_INFO: `/v3/projects/ad04b50aa0114757a9d4c5d6e0ad48db/users/e8fddcdacb1d46fbaf9e5f9cf4b75894/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.559407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad04b50aa0114757a9d4c5d6e0ad48db, user_id=e8fddcdacb1d46fbaf9e5f9cf4b75894, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.560837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.561470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 996/1992] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:41.562435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.563836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.579436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 997/1993] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:41 2022] PUT /identity/v3/projects/ad04b50aa0114757a9d4c5d6e0ad48db/users/e8fddcdacb1d46fbaf9e5f9cf4b75894/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:41.580901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.581458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c48bb1-ebdf-4272-91d0-47d5cb17a682 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.645512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.646408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.646779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.647059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] PATH_INFO: `/v3/projects/05757c8877864894a19e46a615c2ba1a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.648266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05757c8877864894a19e46a615c2ba1a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.651447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.665508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4d4a-9d23-4aca-a51b-575386365fdb admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.672318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.673299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.673653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.674030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] PATH_INFO: `/v3/projects/27c66c53d7c443749ee12d9c6478a8e3/users/a29a589c1141436ba4c052ceff48a99f/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.693333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c66c53d7c443749ee12d9c6478a8e3, user_id=a29a589c1141436ba4c052ceff48a99f, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.700949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.712780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05757c8877864894a19e46a615c2ba1a', 'request_id': 'req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.723631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 998/1994] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:41 2022] PUT /identity/v3/projects/27c66c53d7c443749ee12d9c6478a8e3/users/a29a589c1141436ba4c052ceff48a99f/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:41.723631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:41.730096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05757c8877864894a19e46a615c2ba1a', 'request_id': 'req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.737923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05757c8877864894a19e46a615c2ba1a', 'request_id': 'req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.755301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] The token cache is being invalidate because project 05757c8877864894a19e46a615c2ba1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:41.755490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.756360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-dbe61cd9-6fd8-4ee6-abfc-8a1f63fdf9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:41.758632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 997/1995] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:41 2022] DELETE /identity/v3/projects/05757c8877864894a19e46a615c2ba1a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:41.763216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aa033-317d-4ce6-9e27-5499234fac54 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.763604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aa033-317d-4ce6-9e27-5499234fac54 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.763872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aa033-317d-4ce6-9e27-5499234fac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.793724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-884aa033-317d-4ce6-9e27-5499234fac54 None None] MFA Rules not processed for user `e8fddcdacb1d46fbaf9e5f9cf4b75894`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:41.795496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-884aa033-317d-4ce6-9e27-5499234fac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.804582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471cbe-2c88-4bcd-af1b-64e84e56c785 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:41.824321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7a30-75c0-4f46-9fa5-ddfe2df9193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:41.825063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7a30-75c0-4f46-9fa5-ddfe2df9193f admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.825411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7a30-75c0-4f46-9fa5-ddfe2df9193f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.825716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7a30-75c0-4f46-9fa5-ddfe2df9193f admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.826508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7a30-75c0-4f46-9fa5-ddfe2df9193f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:41.829504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7a30-75c0-4f46-9fa5-ddfe2df9193f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:41.878837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 999/1996] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:41 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:41.883071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e8d3-7c9a-465e-a388-124c96597c9a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.883392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e8d3-7c9a-465e-a388-124c96597c9a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.883694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e8d3-7c9a-465e-a388-124c96597c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.885338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 998/1997] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:41.886803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:41.887098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:41.887373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:41.918549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:41.919313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:41.928618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8ea8e8d3-7c9a-465e-a388-124c96597c9a None None] MFA Rules not processed for user `a29a589c1141436ba4c052ceff48a99f`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:41.932206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8ea8e8d3-7c9a-465e-a388-124c96597c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:42.047971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 999/1998] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:42.047971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.047971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:42.061348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dafc0c-d33d-45a6-88c0-89a217e0dc2d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.067376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.068207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.068662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.069037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.069959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.072820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.120882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1000/1999] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:42 2022] POST /identity/v3/users => generated 300 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:42.121663 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.124054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:42.125061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1000/2000] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:42.126780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4bfb1-c451-4b81-80b7-e7b507df0d4e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.127223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4bfb1-c451-4b81-80b7-e7b507df0d4e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.127649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4bfb1-c451-4b81-80b7-e7b507df0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.138908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1bea-977a-4b62-8945-f6402897c6b5 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.145336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.146296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.146650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.146999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.147769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.150065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.161680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-44d4bfb1-c451-4b81-80b7-e7b507df0d4e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:42.163026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-44d4bfb1-c451-4b81-80b7-e7b507df0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:42.178439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1001/2001] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:42.179266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4bfb1-c451-4b81-80b7-e7b507df0d4e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.188006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1001/2002] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:42 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:42.189247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.191618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:42.200117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4bfb1-c451-4b81-80b7-e7b507df0d4e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.278975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.279907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.280245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.280525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.281237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.284306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.297773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1002/2003] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:42.299395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.302049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f073-5781-4ace-a775-d6515e9cc4c5 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.316284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d22d84-ef14-474b-9959-c89e25476815 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.318327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.319341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.319833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.320286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.322625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.323369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.323711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.324223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.325154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:42.325515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.327878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.343822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1003/2004] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:42.344975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.355616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7bbd9-0463-4515-8f47-53743bf0b875 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.361984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.362790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.363206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.363583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.364387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.366977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.397305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1004/2005] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:42 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:42.402568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.405736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.407282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.413413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc5b9-6023-4ba2-a055-6481bc380679 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.418536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1002/2006] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:42.420058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.422759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.423995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.424173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.424455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] PATH_INFO: `/v3/projects/e3d6105ae7ba4da08bdc43d19b9529c0/users/aa334f5935e14327b65e7d2f6941557b/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.436181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fd4e3-f879-4159-b72c-68f6cb5b8c15 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.441464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.442308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.442599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.442876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.443712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.445929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.456387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d6105ae7ba4da08bdc43d19b9529c0, user_id=aa334f5935e14327b65e7d2f6941557b, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.459619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.487740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1005/2007] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:42 2022] PUT /identity/v3/projects/e3d6105ae7ba4da08bdc43d19b9529c0/users/aa334f5935e14327b65e7d2f6941557b/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:42.489318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.499860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1003/2008] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:42 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:42.509233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.600976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28af62-0253-429a-b17e-370cf7e16fbc admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.646968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bbf63-ad82-45bc-94ec-42d26915473d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.658067 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.658921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.659217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.659496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.660243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.664663 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.695653 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.696561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.697285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1004/2009] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:42.698189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.700717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.701204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.702265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.705381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.709872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f0d5c-21c9-46bc-b9cf-ab6af88600b8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.720705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1006/2010] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:42.721404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.721942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.722418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.722798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.723312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.724163 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.726260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.734479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6918b-101e-467f-a815-a2ea8d87e26c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.740247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.741151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.741449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.741732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] PATH_INFO: `/v3/projects/e3d6105ae7ba4da08bdc43d19b9529c0/users/aa334f5935e14327b65e7d2f6941557b/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.744308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d6105ae7ba4da08bdc43d19b9529c0, user_id=aa334f5935e14327b65e7d2f6941557b, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.747820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.755098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1005/2011] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:42 2022] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:42.756174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.764425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1007/2012] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:42 2022] PUT /identity/v3/projects/e3d6105ae7ba4da08bdc43d19b9529c0/users/aa334f5935e14327b65e7d2f6941557b/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:42.765107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:42.772925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1101bd-3af0-47cd-a525-2ec56bf99d26 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.851785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396fa7f-ca14-48ed-a5b8-2fc51769aa0b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:42.858212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1df8f-6a78-46db-b21d-e05082289709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.858477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1df8f-6a78-46db-b21d-e05082289709 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.858670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1df8f-6a78-46db-b21d-e05082289709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.859002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1df8f-6a78-46db-b21d-e05082289709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.859881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1df8f-6a78-46db-b21d-e05082289709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.861631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1df8f-6a78-46db-b21d-e05082289709 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.875948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1008/2013] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:42.875948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59420-5489-4361-b717-682f41a19e88 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.875948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59420-5489-4361-b717-682f41a19e88 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.875948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59420-5489-4361-b717-682f41a19e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.888706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:42.890130 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:42.890411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:42.890684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] PATH_INFO: `/v3/projects/99ea7a8d03b447f1a17ae7cee021f875/users/5adda3cbfce4497ba6badc73fbdcbd05/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:42.914052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ea7a8d03b447f1a17ae7cee021f875, user_id=5adda3cbfce4497ba6badc73fbdcbd05, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:42.916056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7ef59420-5489-4361-b717-682f41a19e88 None None] MFA Rules not processed for user `aa334f5935e14327b65e7d2f6941557b`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:42.916710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:42.917276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7ef59420-5489-4361-b717-682f41a19e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:42.941247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1006/2014] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:42 2022] PUT /identity/v3/projects/99ea7a8d03b447f1a17ae7cee021f875/users/5adda3cbfce4497ba6badc73fbdcbd05/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:42.941247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.004415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1009/2015] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:43.008540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef59420-5489-4361-b717-682f41a19e88 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.016710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bc215-2f4b-4d1d-8cde-ab82350a3edd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.021471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef59420-5489-4361-b717-682f41a19e88 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.022477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.023234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.023526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.023804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.025261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.026693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.026810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.027538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.027890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.028472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.030377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.032058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.038341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1007/2016] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:43.039327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.042390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1010/2017] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:43.046461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.058002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37880fd-8f33-42bf-9f46-9cab70531f8a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.063649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.064535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.064816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.065091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] PATH_INFO: `/v3/projects/8df6e60ae2114b50bfbddefebf379d71/users/96c76957b2074a77a7c374a724804270/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.085723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df6e60ae2114b50bfbddefebf379d71, user_id=96c76957b2074a77a7c374a724804270, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.089377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.100374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9d96c-6a92-4214-8a16-9996592e8a3e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.109045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1011/2018] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:43 2022] PUT /identity/v3/projects/8df6e60ae2114b50bfbddefebf379d71/users/96c76957b2074a77a7c374a724804270/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:43.109976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.175709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a48b35-f2b5-4432-a1a1-65515da4d25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.176538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48b35-f2b5-4432-a1a1-65515da4d25b service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.176830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48b35-f2b5-4432-a1a1-65515da4d25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.177114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48b35-f2b5-4432-a1a1-65515da4d25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.188972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b060ae4-a0f4-4d9c-9465-f5ca1ca4df43 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.195048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3636b87-7655-41ef-abf1-6660203c9098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.196253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636b87-7655-41ef-abf1-6660203c9098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.196801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636b87-7655-41ef-abf1-6660203c9098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.197157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636b87-7655-41ef-abf1-6660203c9098 admin admin] PATH_INFO: `/v3/projects/99ea7a8d03b447f1a17ae7cee021f875/users/5adda3cbfce4497ba6badc73fbdcbd05/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.199581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3636b87-7655-41ef-abf1-6660203c9098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ea7a8d03b447f1a17ae7cee021f875, user_id=5adda3cbfce4497ba6badc73fbdcbd05, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.202988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3636b87-7655-41ef-abf1-6660203c9098 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.221754 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1012/2019] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:43 2022] PUT /identity/v3/projects/99ea7a8d03b447f1a17ae7cee021f875/users/5adda3cbfce4497ba6badc73fbdcbd05/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:43.222863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b31e-be3e-4c7f-a801-b728edf645ff None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.223143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b31e-be3e-4c7f-a801-b728edf645ff None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.223420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b31e-be3e-4c7f-a801-b728edf645ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.254518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-82d8b31e-be3e-4c7f-a801-b728edf645ff None None] MFA Rules not processed for user `96c76957b2074a77a7c374a724804270`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:43.255767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-82d8b31e-be3e-4c7f-a801-b728edf645ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.268154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a48b35-f2b5-4432-a1a1-65515da4d25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.269658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a48b35-f2b5-4432-a1a1-65515da4d25b service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.279518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1008/2020] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:43.280854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6825ba-c6b2-417d-a977-60890e74e9cf None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.281256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6825ba-c6b2-417d-a977-60890e74e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.281540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6825ba-c6b2-417d-a977-60890e74e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.322687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4b6825ba-c6b2-417d-a977-60890e74e9cf None None] MFA Rules not processed for user `5adda3cbfce4497ba6badc73fbdcbd05`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:43.324713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4b6825ba-c6b2-417d-a977-60890e74e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.355726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1013/2021] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:43.357633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8b31e-be3e-4c7f-a801-b728edf645ff None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.409546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1009/2022] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:43.410438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6825ba-c6b2-417d-a977-60890e74e9cf None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.428551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8b31e-be3e-4c7f-a801-b728edf645ff None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.433232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.434195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.434422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.434726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] PATH_INFO: `/v3/users/ddc3549898e64aa587beb5ec25ebd98d` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.435916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc3549898e64aa587beb5ec25ebd98d)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.437882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.478041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6825ba-c6b2-417d-a977-60890e74e9cf None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.483330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.483989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.484274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.484552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.485264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.486288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc3549898e64aa587beb5ec25ebd98d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.487209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.493784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc3549898e64aa587beb5ec25ebd98d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.494404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc3549898e64aa587beb5ec25ebd98d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.507351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc3549898e64aa587beb5ec25ebd98d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.508086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc3549898e64aa587beb5ec25ebd98d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.517515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1010/2023] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:43 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:43.517515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.517515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.519875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1014/2024] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:43 2022] DELETE /identity/v3/users/ddc3549898e64aa587beb5ec25ebd98d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:43.520667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.522018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.578337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50273b03-9885-4729-b6ca-5298a2fa5f79 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.579859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6441a16-e8ed-4960-bcfd-c83bc5184b4b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.584855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.585594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.585971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.586343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.588338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.638871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.639741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.640017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.640322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] PATH_INFO: `/v3/users/ac18c8a4b8d640d5a0daf98328a3135d` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.641511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac18c8a4b8d640d5a0daf98328a3135d)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.643450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.655594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.657031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.666605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1015/2025] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:43.667219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.668544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.682255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8f2e5-d57e-4ac7-981d-e211a813cf62 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.687837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d44dd-b9c0-4a38-bd70-e815ca2ab071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.688543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d44dd-b9c0-4a38-bd70-e815ca2ab071 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.688829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d44dd-b9c0-4a38-bd70-e815ca2ab071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.689106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d44dd-b9c0-4a38-bd70-e815ca2ab071 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.689834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d44dd-b9c0-4a38-bd70-e815ca2ab071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.691819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d44dd-b9c0-4a38-bd70-e815ca2ab071 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.695237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac18c8a4b8d640d5a0daf98328a3135d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.711327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac18c8a4b8d640d5a0daf98328a3135d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.712429 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac18c8a4b8d640d5a0daf98328a3135d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.729356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac18c8a4b8d640d5a0daf98328a3135d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.729940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1016/2026] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:43 2022] POST /identity/v3/users => generated 303 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:43.730149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac18c8a4b8d640d5a0daf98328a3135d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:43.734489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74a14-f679-4b66-ae9e-751932f1132f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.734614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74a14-f679-4b66-ae9e-751932f1132f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.734875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74a14-f679-4b66-ae9e-751932f1132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.750063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1011/2027] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:43 2022] DELETE /identity/v3/users/ac18c8a4b8d640d5a0daf98328a3135d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:43.753151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.753151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.756915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e8f74a14-f679-4b66-ae9e-751932f1132f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:43.758469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e8f74a14-f679-4b66-ae9e-751932f1132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.832812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc0bca-0c44-45c4-8e19-b6eb48a6ec20 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.834047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1017/2028] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:43.835239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc88f1-c814-469e-8da8-4052c67b0f36 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.835598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc88f1-c814-469e-8da8-4052c67b0f36 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.835979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc88f1-c814-469e-8da8-4052c67b0f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.840973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.842273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.842560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.842840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.843587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.845274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.857949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1012/2029] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:43.858140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.861034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f1dc88f1-c814-469e-8da8-4052c67b0f36 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:43.862389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f1dc88f1-c814-469e-8da8-4052c67b0f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.866940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:43.874771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1018/2030] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:43.875814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc88f1-c814-469e-8da8-4052c67b0f36 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.887479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc88f1-c814-469e-8da8-4052c67b0f36 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.897468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.898479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.898820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.899165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] PATH_INFO: `/v3/projects/50c3de6807504c3e9abfd634b7262df5/users/4d3903531c8f4ac7a620a1ebb805f8f2/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.923107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c3de6807504c3e9abfd634b7262df5, user_id=4d3903531c8f4ac7a620a1ebb805f8f2, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.926689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.948258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a836-78a0-41d5-880d-a84a7b8b7f51 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:43.956492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:43.957345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:43.957680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:43.958002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:43.963199 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1019/2031] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:43 2022] PUT /identity/v3/projects/50c3de6807504c3e9abfd634b7262df5/users/4d3903531c8f4ac7a620a1ebb805f8f2/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:43.964547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:43.974236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:43.975932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:43.999943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1013/2032] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:44.000840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.011439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b944f-23f9-4112-a23a-cb8ecd12ac00 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.052201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e36fe5-eccd-4498-92d2-c9d8afb7c64e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.056847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.057935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.058244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.058562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.089922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95327c-4baa-47a3-8de0-a44a20c2bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.091155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95327c-4baa-47a3-8de0-a44a20c2bbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.091473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95327c-4baa-47a3-8de0-a44a20c2bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.091753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95327c-4baa-47a3-8de0-a44a20c2bbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.093025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95327c-4baa-47a3-8de0-a44a20c2bbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.094753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95327c-4baa-47a3-8de0-a44a20c2bbb0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.108920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1014/2033] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:44.110672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.111012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.112349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.136071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] MFA Rules not processed for user `a29a589c1141436ba4c052ceff48a99f`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:44.137552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.147832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.149294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.178484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1020/2034] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:44.179695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.192186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06bffb-9d4f-410c-8ed4-eb72bfa31297 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.198594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f3d54-0594-4ce0-96f1-284b8c50928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.199677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3d54-0594-4ce0-96f1-284b8c50928e admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.200283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3d54-0594-4ce0-96f1-284b8c50928e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.200780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3d54-0594-4ce0-96f1-284b8c50928e admin admin] PATH_INFO: `/v3/projects/50c3de6807504c3e9abfd634b7262df5/users/4d3903531c8f4ac7a620a1ebb805f8f2/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.204251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f3d54-0594-4ce0-96f1-284b8c50928e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c3de6807504c3e9abfd634b7262df5, user_id=4d3903531c8f4ac7a620a1ebb805f8f2, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.208133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f3d54-0594-4ce0-96f1-284b8c50928e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.221480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1015/2035] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:44.223041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.226448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1021/2036] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:44 2022] PUT /identity/v3/projects/50c3de6807504c3e9abfd634b7262df5/users/4d3903531c8f4ac7a620a1ebb805f8f2/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:44.226591 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.249488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142b2b7-7d7d-4b32-aaf7-945bc8bbd62b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.251196 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.254017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.254422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.322464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] MFA Rules not processed for user `4d3903531c8f4ac7a620a1ebb805f8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:44.323840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.332718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.333875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.334310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.334740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] PATH_INFO: `/v3/users/e8fddcdacb1d46fbaf9e5f9cf4b75894` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.336152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fddcdacb1d46fbaf9e5f9cf4b75894)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.338318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.424174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fddcdacb1d46fbaf9e5f9cf4b75894'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.433181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fddcdacb1d46fbaf9e5f9cf4b75894'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.433982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fddcdacb1d46fbaf9e5f9cf4b75894'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.444290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1022/2037] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:44.445016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.447318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.463683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fddcdacb1d46fbaf9e5f9cf4b75894'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.464512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fddcdacb1d46fbaf9e5f9cf4b75894'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.474515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81f20-9238-4369-a25b-7031f393abc5 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.483562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.484738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.486091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.486312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] PATH_INFO: `/v3/projects/a73f008ce2c14f66b0a8e934c8e91330` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.492644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73f008ce2c14f66b0a8e934c8e91330)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.495664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.504899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1016/2038] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:44 2022] DELETE /identity/v3/users/e8fddcdacb1d46fbaf9e5f9cf4b75894 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:44.504899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.504899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.570589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73f008ce2c14f66b0a8e934c8e91330', 'request_id': 'req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.576532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c3ee-7e05-4ee2-af87-dce4a91013f4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.583365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73f008ce2c14f66b0a8e934c8e91330', 'request_id': 'req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.594131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73f008ce2c14f66b0a8e934c8e91330', 'request_id': 'req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.615390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] The token cache is being invalidate because project a73f008ce2c14f66b0a8e934c8e91330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:44.615390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.616097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-96e15ab0-6c4d-42bb-92a0-b9ebaaf993e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.623165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1023/2039] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:44 2022] DELETE /identity/v3/projects/a73f008ce2c14f66b0a8e934c8e91330 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:44.625048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.625132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.625597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.647314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:44.648824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.673776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.675241 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.675537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.675953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.680677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.742114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1024/2040] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:44.744801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.747056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.760916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48fc46-1a92-4106-8613-f484f266d8ae None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.766941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.767823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.768173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.768377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] PATH_INFO: `/v3/users/aa334f5935e14327b65e7d2f6941557b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.769660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa334f5935e14327b65e7d2f6941557b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.771649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.786698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.788349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.799884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1017/2041] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:44.801787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.802904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.818763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cfa89-675d-4e43-9deb-75868ef94809 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:44.825393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:44.826599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:44.827240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:44.827522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] PATH_INFO: `/v3/projects/3b9c33e3ea1e4597864659adec24b7f1` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:44.828755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9c33e3ea1e4597864659adec24b7f1)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:44.830766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:44.838528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa334f5935e14327b65e7d2f6941557b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.854793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa334f5935e14327b65e7d2f6941557b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.854793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa334f5935e14327b65e7d2f6941557b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.872498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa334f5935e14327b65e7d2f6941557b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.874008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa334f5935e14327b65e7d2f6941557b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.888079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1025/2042] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:44 2022] DELETE /identity/v3/users/aa334f5935e14327b65e7d2f6941557b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:44.888954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.890401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:44.890999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9c33e3ea1e4597864659adec24b7f1', 'request_id': 'req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.903300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9c33e3ea1e4597864659adec24b7f1', 'request_id': 'req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.919076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9c33e3ea1e4597864659adec24b7f1', 'request_id': 'req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.934694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] The token cache is being invalidate because project 3b9c33e3ea1e4597864659adec24b7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:44.935812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.936512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:44.942085 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1018/2043] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:44 2022] DELETE /identity/v3/projects/3b9c33e3ea1e4597864659adec24b7f1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:44.945305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:44.950985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:45.006227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622272-510b-44cc-969b-52b6300d5d9f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:45.014523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:45.015370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.015658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.015933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.018670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:45.086109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a0a2-d40c-4465-a4fc-c3cc4ed3139b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:45.181119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:45.182557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.183637 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.184176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.187714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:45.190137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:45.191237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:45.218577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1026/2044] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:45.223018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:45.225243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:45.269879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0f44-7b64-41a2-ac4f-1fd6ba7fa993 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:45.279290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:45.281429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.282343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.282945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] PATH_INFO: `/v3/users/1b3e696042df46ee94a75e7baa03aeb7` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.285226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3e696042df46ee94a75e7baa03aeb7)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:45.296477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:45.336661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:45.339656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:45.351805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1019/2045] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:45.384353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3e696042df46ee94a75e7baa03aeb7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.392211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3e696042df46ee94a75e7baa03aeb7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.396323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3e696042df46ee94a75e7baa03aeb7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.397764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:45.399281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:45.409132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3e696042df46ee94a75e7baa03aeb7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.410143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32e7a2ea-5e4d-4f2c-9614-d095629bc8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3e696042df46ee94a75e7baa03aeb7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.421197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccabf1-e065-4e17-989c-a379d75c22f5 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:45.426204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:45.430750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1027/2046] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:45 2022] DELETE /identity/v3/users/1b3e696042df46ee94a75e7baa03aeb7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:45.436033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.436517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.437059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] PATH_INFO: `/v3/projects/e3d6105ae7ba4da08bdc43d19b9529c0` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.439428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d6105ae7ba4da08bdc43d19b9529c0)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:45.442982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:45.557143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d6105ae7ba4da08bdc43d19b9529c0', 'request_id': 'req-4efbd46b-7614-4a36-8311-50941d81f965'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.578932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d6105ae7ba4da08bdc43d19b9529c0', 'request_id': 'req-4efbd46b-7614-4a36-8311-50941d81f965'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.586980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d6105ae7ba4da08bdc43d19b9529c0', 'request_id': 'req-4efbd46b-7614-4a36-8311-50941d81f965'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.607474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] The token cache is being invalidate because project e3d6105ae7ba4da08bdc43d19b9529c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:45.607969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.608811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4efbd46b-7614-4a36-8311-50941d81f965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:45.611193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1020/2047] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:45 2022] DELETE /identity/v3/projects/e3d6105ae7ba4da08bdc43d19b9529c0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:45.615646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d713-366f-40f6-a31d-9f740d8be3d1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.616111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d713-366f-40f6-a31d-9f740d8be3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.616537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d713-366f-40f6-a31d-9f740d8be3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.645659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f917d713-366f-40f6-a31d-9f740d8be3d1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:45.648920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f917d713-366f-40f6-a31d-9f740d8be3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:45.741750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1028/2048] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:45.751754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306056b2-88b5-4b7d-b84f-3ec5746cc885 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.752202 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306056b2-88b5-4b7d-b84f-3ec5746cc885 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.752342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306056b2-88b5-4b7d-b84f-3ec5746cc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.820699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-306056b2-88b5-4b7d-b84f-3ec5746cc885 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:45.825287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-306056b2-88b5-4b7d-b84f-3ec5746cc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:45.838471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1021/2049] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:45.842879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917d713-366f-40f6-a31d-9f740d8be3d1 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:45.865819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917d713-366f-40f6-a31d-9f740d8be3d1 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:45.883567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:45.884167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.884592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.885520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.886387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:45.887855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:45.890399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:45.938509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1029/2050] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:45:45.943899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306056b2-88b5-4b7d-b84f-3ec5746cc885 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:45.958148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306056b2-88b5-4b7d-b84f-3ec5746cc885 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:45.986054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:45.986976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:45.987492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:45.987951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:45.989152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:45.993156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.015047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.017721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.040305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cde8-d9a9-402b-b796-6da95adb97d4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.052016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1022/2051] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:45 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:46.052438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.053593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.054080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.054566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] PATH_INFO: `/v3/projects/ad04b50aa0114757a9d4c5d6e0ad48db` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.055813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.056722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad04b50aa0114757a9d4c5d6e0ad48db)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.061632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.148769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad04b50aa0114757a9d4c5d6e0ad48db', 'request_id': 'req-16f31d80-3d92-4125-8247-785c0f993459'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.161439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad04b50aa0114757a9d4c5d6e0ad48db', 'request_id': 'req-16f31d80-3d92-4125-8247-785c0f993459'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.173654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad04b50aa0114757a9d4c5d6e0ad48db', 'request_id': 'req-16f31d80-3d92-4125-8247-785c0f993459'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.204441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] The token cache is being invalidate because project ad04b50aa0114757a9d4c5d6e0ad48db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:46.205041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.205148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387c723-4a68-4c21-91fe-b4289986ca22 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.206472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.210771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1030/2052] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:46 2022] DELETE /identity/v3/projects/ad04b50aa0114757a9d4c5d6e0ad48db => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:46.213602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.214170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.300275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.300776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.301066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.301342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.302080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.304258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.327736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f31d80-3d92-4125-8247-785c0f993459 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.332881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.333746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.334039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.334318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] PATH_INFO: `/v3/projects/fb686cb177a744a89b6646e3e7bd6d28` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.335538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb686cb177a744a89b6646e3e7bd6d28)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.338583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1023/2053] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:46 2022] POST /identity/v3/users => generated 290 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:46.338583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.338814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.339206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.353888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca71198-8bf2-4ebb-929c-5c6f8875e28f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.361810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.363628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.363935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.364218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] PATH_INFO: `/v3/users/5adda3cbfce4497ba6badc73fbdcbd05` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.366319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adda3cbfce4497ba6badc73fbdcbd05)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.371542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.390986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb686cb177a744a89b6646e3e7bd6d28', 'request_id': 'req-d87e604e-2ca0-47e2-92de-5f4a656788bd'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.399670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb686cb177a744a89b6646e3e7bd6d28', 'request_id': 'req-d87e604e-2ca0-47e2-92de-5f4a656788bd'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.407244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb686cb177a744a89b6646e3e7bd6d28', 'request_id': 'req-d87e604e-2ca0-47e2-92de-5f4a656788bd'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.418153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] The token cache is being invalidate because project fb686cb177a744a89b6646e3e7bd6d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:46.418458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.419040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.421230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1031/2054] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:46 2022] DELETE /identity/v3/projects/fb686cb177a744a89b6646e3e7bd6d28 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:46.422151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.426051 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.430398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adda3cbfce4497ba6badc73fbdcbd05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.445852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adda3cbfce4497ba6badc73fbdcbd05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.453853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adda3cbfce4497ba6badc73fbdcbd05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.477684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adda3cbfce4497ba6badc73fbdcbd05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.478758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-848544e4-7aea-4a85-8caf-72a82900c065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adda3cbfce4497ba6badc73fbdcbd05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:46.499123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1024/2055] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:46 2022] DELETE /identity/v3/users/5adda3cbfce4497ba6badc73fbdcbd05 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:46.501586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4db54b-5fa3-4444-8f99-af4303ec6805 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.501586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4db54b-5fa3-4444-8f99-af4303ec6805 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.501586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4db54b-5fa3-4444-8f99-af4303ec6805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.512456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e604e-2ca0-47e2-92de-5f4a656788bd admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.542027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ff4db54b-5fa3-4444-8f99-af4303ec6805 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:46.544025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ff4db54b-5fa3-4444-8f99-af4303ec6805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.616433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.617233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.619630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.619630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.619630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.622112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.640147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1032/2056] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:46.641330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.642346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1025/2057] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:46.645112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.653218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c6e1b-d509-4ee4-ade3-f792bc94befc None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.653508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c6e1b-d509-4ee4-ade3-f792bc94befc None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.658056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c6e1b-d509-4ee4-ade3-f792bc94befc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.666192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a70e7-a487-4405-a461-f6c3108fc996 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.672198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.672862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.673149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.673429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.674432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.675886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.685463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-561c6e1b-d509-4ee4-ade3-f792bc94befc None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:46.687818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-561c6e1b-d509-4ee4-ade3-f792bc94befc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.689612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1033/2058] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:46.693866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.698618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1026/2059] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:46.703421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c6e1b-d509-4ee4-ade3-f792bc94befc None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.710395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b707-29a4-4191-a2ab-d6b13c590e9f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.716021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b1c20-01eb-4ff6-a550-218a06a2cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.716931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c6e1b-d509-4ee4-ade3-f792bc94befc None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.717346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1c20-01eb-4ff6-a550-218a06a2cfb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.717761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1c20-01eb-4ff6-a550-218a06a2cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.718256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1c20-01eb-4ff6-a550-218a06a2cfb3 admin admin] PATH_INFO: `/v3/projects/52f9be0b3f2a49a09e32724649704f64/users/c37952b327e74818a03d5ae6cf540401/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.724623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.725300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.725585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.725897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.726726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:46.727197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.729017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.738219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b1c20-01eb-4ff6-a550-218a06a2cfb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f9be0b3f2a49a09e32724649704f64, user_id=c37952b327e74818a03d5ae6cf540401, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.741444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b1c20-01eb-4ff6-a550-218a06a2cfb3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.746895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1027/2060] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:46.750081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.762343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1e41-708c-42e3-9861-6b0ee19a7613 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.770235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1034/2061] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:46 2022] PUT /identity/v3/projects/52f9be0b3f2a49a09e32724649704f64/users/c37952b327e74818a03d5ae6cf540401/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:46.781031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c528e0-be05-47bc-aad7-67d3b3300989 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.781300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c528e0-be05-47bc-aad7-67d3b3300989 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.781568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c528e0-be05-47bc-aad7-67d3b3300989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.841675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.841932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.842209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.842489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.843200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.843628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b1c528e0-be05-47bc-aad7-67d3b3300989 None None] MFA Rules not processed for user `c37952b327e74818a03d5ae6cf540401`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:46.845141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:46.845569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b1c528e0-be05-47bc-aad7-67d3b3300989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:46.889212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1028/2062] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:46 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:46.893825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:46.983530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609274-6f25-48b8-8ac8-b777ad6dada0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:46.990976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:46.991927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:46.992225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:46.993694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:46.994676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:46.997417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.000289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1035/2063] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:47.004887 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c528e0-be05-47bc-aad7-67d3b3300989 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.018124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c528e0-be05-47bc-aad7-67d3b3300989 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.023428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.024269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.024557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.024837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.025539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.027539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.029310 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1029/2064] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:46 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:47.030416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.042947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c9c7c-171c-4bae-b4d9-81cfbd9cf198 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.050742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.051429 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.052116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.052413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.054520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.064022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1036/2065] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:47 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:47.066040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.070949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.092524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1030/2066] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:47.125106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.159354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fcaea-990a-4179-97a9-204b05f22caa admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.163749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dccc46-7121-43f6-aebf-b89230b51eb5 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.173527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.174273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.174562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.174841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.175551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.179586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.180258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.180390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.180574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.180814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.181545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.183177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.209979 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1031/2067] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:47.210810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.214870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:47.222518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1037/2068] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:47 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:47.223429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.242690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bc27-9ef2-4b00-80bd-2d4157776367 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.248534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243d387-40ee-4307-96a0-1ab35fed9b6c admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.259560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.259797 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.260587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.260934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.261341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] PATH_INFO: `/v3/projects/6398a076a52145ca9bcca22e1521cc22/users/0a0a901c69fd45d792534186d853a8d4/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.263479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.263773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.264060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] PATH_INFO: `/v3/projects/99ea7a8d03b447f1a17ae7cee021f875` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.270404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ea7a8d03b447f1a17ae7cee021f875)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.275087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.291306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6398a076a52145ca9bcca22e1521cc22, user_id=0a0a901c69fd45d792534186d853a8d4, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.295687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.313794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1038/2069] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:47 2022] PUT /identity/v3/projects/6398a076a52145ca9bcca22e1521cc22/users/0a0a901c69fd45d792534186d853a8d4/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:47.314780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.420355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ea7a8d03b447f1a17ae7cee021f875', 'request_id': 'req-3c1e8356-7547-49ef-a85d-1d0e652b0b69'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:47.438069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ea7a8d03b447f1a17ae7cee021f875', 'request_id': 'req-3c1e8356-7547-49ef-a85d-1d0e652b0b69'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:47.446391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ea7a8d03b447f1a17ae7cee021f875', 'request_id': 'req-3c1e8356-7547-49ef-a85d-1d0e652b0b69'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:47.471989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] The token cache is being invalidate because project 99ea7a8d03b447f1a17ae7cee021f875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:47.472898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:47.474538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3c1e8356-7547-49ef-a85d-1d0e652b0b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:47.477756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1032/2070] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:47 2022] DELETE /identity/v3/projects/99ea7a8d03b447f1a17ae7cee021f875 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:47.481463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c09772-c2a7-46cb-ad00-a07f8723fc3d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.482461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c09772-c2a7-46cb-ad00-a07f8723fc3d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.482893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c09772-c2a7-46cb-ad00-a07f8723fc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.485586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0922e5-5e67-4716-9dfe-e70d8c58b043 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.524988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-41c09772-c2a7-46cb-ad00-a07f8723fc3d None None] MFA Rules not processed for user `0a0a901c69fd45d792534186d853a8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:47.526560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-41c09772-c2a7-46cb-ad00-a07f8723fc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:47.625520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.626258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.626532 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.626816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.628609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.629242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.646797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1033/2071] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:47.648240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.648534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.648816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.656139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1039/2072] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:47.657080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.662124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:47.685672 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:47.686991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:47.692153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0a43f-b375-4515-a997-45a3095dba8c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.703941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1034/2073] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:47.704884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.706627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb79224-dbcc-408a-b410-bef91c74b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.706763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:47.707516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb79224-dbcc-408a-b410-bef91c74b5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.707996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb79224-dbcc-408a-b410-bef91c74b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.708289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb79224-dbcc-408a-b410-bef91c74b5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.709494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb79224-dbcc-408a-b410-bef91c74b5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.714805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb79224-dbcc-408a-b410-bef91c74b5d3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.724153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f192261-26ee-4113-8ca3-d4f0b2875b47 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.730510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.732548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.732903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.733253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] PATH_INFO: `/v3/projects/d6696f246e0d4e668f1eca55c8f25f57/users/f9df11e005f948dbbb12fc432df1489b/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.761410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6696f246e0d4e668f1eca55c8f25f57, user_id=f9df11e005f948dbbb12fc432df1489b, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.764577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.766701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1040/2074] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:47 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:47.768611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eae04-ec09-4d23-ad84-d7dbf235f1ea None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.769760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eae04-ec09-4d23-ad84-d7dbf235f1ea None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.770433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eae04-ec09-4d23-ad84-d7dbf235f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.793611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1035/2075] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:47 2022] PUT /identity/v3/projects/d6696f246e0d4e668f1eca55c8f25f57/users/f9df11e005f948dbbb12fc432df1489b/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:47.795322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.797617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-950eae04-ec09-4d23-ad84-d7dbf235f1ea None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:47.798979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-950eae04-ec09-4d23-ad84-d7dbf235f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:47.896569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1041/2076] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:47.897904 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eae04-ec09-4d23-ad84-d7dbf235f1ea None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.912900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eae04-ec09-4d23-ad84-d7dbf235f1ea None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.917963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.918691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.919173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.920129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.921091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.922150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e1530-0564-4225-9b89-2bf4484a8b95 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.922726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.930488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.931167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.931449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.931770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.932554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.943592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.943705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1042/2077] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:47.943705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:47.960055 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c089d3-3a9d-4003-ae49-abf325eac1b0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:47.968914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:47.969646 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:47.970221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:47.970452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:47.971485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:47.971861 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:47.974929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:47.979432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1036/2078] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:47 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:47.980043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.007169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1043/2079] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:48.007169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.018544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f49d2e-55bf-4633-9864-b591ec2ae905 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.027716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c761b-b958-4fa9-b9c9-1c8269f92358 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.030934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.031826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.032102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.032371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] PATH_INFO: `/v3/projects/d6696f246e0d4e668f1eca55c8f25f57/users/f9df11e005f948dbbb12fc432df1489b/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.035523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6696f246e0d4e668f1eca55c8f25f57, user_id=f9df11e005f948dbbb12fc432df1489b, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.038758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.043354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.044022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.044879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.045163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.045911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.047517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.067870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1044/2080] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:48.067870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.068232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1037/2081] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:47 2022] PUT /identity/v3/projects/d6696f246e0d4e668f1eca55c8f25f57/users/f9df11e005f948dbbb12fc432df1489b/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:48.068232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.096862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87384a37-debb-4542-b8af-02633d9184c4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.206997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ea3c-74c8-4ebe-a60e-d43f6db24699 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.213854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7067c-af86-4a42-ad7a-2da735fb66c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.214793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7067c-af86-4a42-ad7a-2da735fb66c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.215068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7067c-af86-4a42-ad7a-2da735fb66c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.215358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7067c-af86-4a42-ad7a-2da735fb66c3 admin admin] PATH_INFO: `/v3/projects/31a001b5df30422b84858bcb468eab09/users/70ee25b4010244c19e1d546c81f71ba5/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.239385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7067c-af86-4a42-ad7a-2da735fb66c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a001b5df30422b84858bcb468eab09, user_id=70ee25b4010244c19e1d546c81f71ba5, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.242135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.242542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7067c-af86-4a42-ad7a-2da735fb66c3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.242806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.243230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.243569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.244478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.249112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.274953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1038/2082] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:48 2022] PUT /identity/v3/projects/31a001b5df30422b84858bcb468eab09/users/70ee25b4010244c19e1d546c81f71ba5/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:48.276723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe15b-1908-4733-9b1f-304d11450f51 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.277115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe15b-1908-4733-9b1f-304d11450f51 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.277968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe15b-1908-4733-9b1f-304d11450f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.287349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1045/2083] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:48 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:48.288180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.318497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-67cbe15b-1908-4733-9b1f-304d11450f51 None None] MFA Rules not processed for user `f9df11e005f948dbbb12fc432df1489b`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:48.320277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-67cbe15b-1908-4733-9b1f-304d11450f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:48.402912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8fee-5963-4fc7-9edb-d7ba5fa08bcf admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.408294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.409242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.409398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.409624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.410375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.411990 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.425210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1046/2084] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:48.425525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.437569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40c5e-c30e-4d95-80d3-737c7fbc0cf0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.439131 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1039/2085] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:48.440091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe15b-1908-4733-9b1f-304d11450f51 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.443979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.444923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.445663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.446187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.447031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.449257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.451727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe15b-1908-4733-9b1f-304d11450f51 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.459758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.460650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.460935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.461213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] PATH_INFO: `/v3/projects/31a001b5df30422b84858bcb468eab09/users/70ee25b4010244c19e1d546c81f71ba5/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.463503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a001b5df30422b84858bcb468eab09, user_id=70ee25b4010244c19e1d546c81f71ba5, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.467315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.477939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1047/2086] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:48 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:48.477939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.485782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1040/2087] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:48 2022] PUT /identity/v3/projects/31a001b5df30422b84858bcb468eab09/users/70ee25b4010244c19e1d546c81f71ba5/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:48.485782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.493750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:48.583158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55fc1f-dbb5-4a0f-814e-2747e8e97a3a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.604118 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc441a4-12e4-47d7-aeff-9db263360369 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.610959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a594-c9a6-42ce-b474-3cf3fbbadb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.612024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a594-c9a6-42ce-b474-3cf3fbbadb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.612489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a594-c9a6-42ce-b474-3cf3fbbadb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.612969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a594-c9a6-42ce-b474-3cf3fbbadb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.613854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a594-c9a6-42ce-b474-3cf3fbbadb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.615480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a594-c9a6-42ce-b474-3cf3fbbadb19 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.627705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1041/2088] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:48.629480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.629803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.630088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.658377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.659250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.659605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.659949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.671050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] MFA Rules not processed for user `70ee25b4010244c19e1d546c81f71ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:48.673031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:48.739294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.741044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.753358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1048/2089] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:48.754718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.766164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09e6f2-c6ef-4698-a05f-77cacd312d02 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.772072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.772743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.773039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.776993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.777243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1042/2090] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:48.777325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.777325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.787797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.789868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:48.795225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1049/2091] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:48.801235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:48.822003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec342-c753-45e9-8b10-5185262b1eab None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.835872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef73f-6c3c-4dab-8bba-07b65ba459a5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:48.846120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298426-fdc9-4830-a9a4-4ec89261222d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.846120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298426-fdc9-4830-a9a4-4ec89261222d service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.846120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298426-fdc9-4830-a9a4-4ec89261222d service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.846120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298426-fdc9-4830-a9a4-4ec89261222d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.850006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100a75-703b-4547-b779-35324f03617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:48.851492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100a75-703b-4547-b779-35324f03617c admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.851777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100a75-703b-4547-b779-35324f03617c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.852726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100a75-703b-4547-b779-35324f03617c admin admin] PATH_INFO: `/v3/projects/bbb524eba1034ac1b411f94e1f4beedb/users/dbec557b65e44387afcd5b2e9c20e83f/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:48.870709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298426-fdc9-4830-a9a4-4ec89261222d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.873320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298426-fdc9-4830-a9a4-4ec89261222d service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.890793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40100a75-703b-4547-b779-35324f03617c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb524eba1034ac1b411f94e1f4beedb, user_id=dbec557b65e44387afcd5b2e9c20e83f, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:48.909321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40100a75-703b-4547-b779-35324f03617c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:48.910243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1043/2092] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:48.945757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1050/2093] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:48 2022] PUT /identity/v3/projects/bbb524eba1034ac1b411f94e1f4beedb/users/dbec557b65e44387afcd5b2e9c20e83f/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:48.952472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95df6-406b-4ed4-8569-13503e23ee70 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:48.952758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95df6-406b-4ed4-8569-13503e23ee70 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:48.953032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95df6-406b-4ed4-8569-13503e23ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.003534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-99c95df6-406b-4ed4-8569-13503e23ee70 None None] MFA Rules not processed for user `dbec557b65e44387afcd5b2e9c20e83f`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:49.004783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-99c95df6-406b-4ed4-8569-13503e23ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:49.109601 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1044/2094] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:49.114743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100a75-703b-4547-b779-35324f03617c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.197744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100a75-703b-4547-b779-35324f03617c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.209022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:49.209995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:49.210366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:49.211599 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.213021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:49.215443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:49.258728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1051/2095] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:49 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:49.262869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c95df6-406b-4ed4-8569-13503e23ee70 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.288918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c95df6-406b-4ed4-8569-13503e23ee70 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.434403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.460472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:49.461162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:49.465591 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:49.465982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.470808 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:49.475211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:49.534548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1045/2096] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:49 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:49.535696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.554572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1467dcf-763d-48b3-910a-3205db49d9cf admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.572735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:49.572735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:49.572735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:49.572735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.573039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:49.581154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:49.604603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1046/2097] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:49.611087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.619059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f6125-bf91-4e22-905f-044eb266b7fe admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.636446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9df11e005f948dbbb12fc432df1489b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6696f246e0d4e668f1eca55c8f25f57', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:49.637819 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:49.639789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:49.640292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.641157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3f84-db33-4ce3-90a9-1c5953784cfa admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.641933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:49.642512 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:49.644629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:49.651793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:49.653355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:49.653858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:49.654184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] PATH_INFO: `/v3/projects/621f819bd5a148eaaa78fdac75679329/users/7eb68564ae3f422896093079dedf1d18/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.681170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1052/2098] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:45:49.686481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.732647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=621f819bd5a148eaaa78fdac75679329, user_id=7eb68564ae3f422896093079dedf1d18, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:49.738318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f6aed-7b75-4951-a1fc-c8c28784510b tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.739631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:49.760187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9df11e005f948dbbb12fc432df1489b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6696f246e0d4e668f1eca55c8f25f57', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:49.763615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:49.764338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:49.764995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.767434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:49.781610 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:49.785900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1047/2099] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:49 2022] PUT /identity/v3/projects/621f819bd5a148eaaa78fdac75679329/users/7eb68564ae3f422896093079dedf1d18/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:49.800547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.870775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1053/2100] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:49 2022] POST /identity/v3/projects => generated 354 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:49.870775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:49.875014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:49.912750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8147aa-ccaf-4c01-b63e-9aec99e9d0ea admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.965075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6591d-374b-4870-aa97-7bd28303a4e9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:49.977993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:49.979692 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:49.980963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:49.980963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] PATH_INFO: `/v3/users/96c76957b2074a77a7c374a724804270` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:49.984859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c76957b2074a77a7c374a724804270)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:49.989927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:50.040438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:50.041789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.042326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.043008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.044051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:50.047464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:50.089687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1048/2101] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:50.092074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:50.107173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c76957b2074a77a7c374a724804270'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.117104 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c76957b2074a77a7c374a724804270'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.120304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c76957b2074a77a7c374a724804270'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.164217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c76957b2074a77a7c374a724804270'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.167513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c76957b2074a77a7c374a724804270'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.211776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1054/2102] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:49 2022] DELETE /identity/v3/users/96c76957b2074a77a7c374a724804270 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:50.214912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:50.221210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.248366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185ba1-57c6-44df-8afe-6210eb10b565 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:50.315071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e9a5-d7b5-419c-ad9b-d03108c7882f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:50.325635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:50.326558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.327096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.327383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] PATH_INFO: `/v3/users/0a0a901c69fd45d792534186d853a8d4` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.329194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0a901c69fd45d792534186d853a8d4)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:50.332019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:50.377974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9df11e005f948dbbb12fc432df1489b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6696f246e0d4e668f1eca55c8f25f57', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:50.379020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.379481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.380177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.383049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:50.383313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:50.386110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:50.412646 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1049/2103] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:50.412646 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:50.415891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.417589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0a901c69fd45d792534186d853a8d4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.435000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3aa83-0fe0-49e7-b5dc-7f3409e90a31 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:50.437130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0a901c69fd45d792534186d853a8d4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.437852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0a901c69fd45d792534186d853a8d4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.454689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0a901c69fd45d792534186d853a8d4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.455693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0f3f1bef-025c-4884-8b5d-04d6564467c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0a901c69fd45d792534186d853a8d4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.464031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:50.464031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.464031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.464031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] PATH_INFO: `/v3/projects/621f819bd5a148eaaa78fdac75679329/users/7eb68564ae3f422896093079dedf1d18/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.468290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621f819bd5a148eaaa78fdac75679329, user_id=7eb68564ae3f422896093079dedf1d18, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:50.471147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:50.490040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1055/2104] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:50 2022] DELETE /identity/v3/users/0a0a901c69fd45d792534186d853a8d4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:50.492407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701dd07-69ba-4f51-bfac-ef77dddfc44b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.492985 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701dd07-69ba-4f51-bfac-ef77dddfc44b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.493489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701dd07-69ba-4f51-bfac-ef77dddfc44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.497788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1050/2105] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:50 2022] PUT /identity/v3/projects/621f819bd5a148eaaa78fdac75679329/users/7eb68564ae3f422896093079dedf1d18/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:50.498529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:50.509694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.535145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7701dd07-69ba-4f51-bfac-ef77dddfc44b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:50.536356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7701dd07-69ba-4f51-bfac-ef77dddfc44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.608450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9393b-d787-4a66-b407-1c3c03cd3243 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:50.619215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9df11e005f948dbbb12fc432df1489b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6696f246e0d4e668f1eca55c8f25f57', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:50.620100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.620387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.620668 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] PATH_INFO: `/v3/projects/2723afb18b8e4339934e34c3629dd0b5` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.627918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2723afb18b8e4339934e34c3629dd0b5)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:50.629919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:50.637593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1056/2106] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:50.639440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d11a7-d284-446b-8909-04c6ef42c856 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.639728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d11a7-d284-446b-8909-04c6ef42c856 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.640007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d11a7-d284-446b-8909-04c6ef42c856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.679077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c54d11a7-d284-446b-8909-04c6ef42c856 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:50.680670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c54d11a7-d284-446b-8909-04c6ef42c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.703076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1057/2107] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:50.707125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.707687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.708075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.714856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2723afb18b8e4339934e34c3629dd0b5', 'request_id': 'req-bbbee035-9ddb-48c8-86ce-834bcfac17f9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.732717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2723afb18b8e4339934e34c3629dd0b5', 'request_id': 'req-bbbee035-9ddb-48c8-86ce-834bcfac17f9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.740019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2723afb18b8e4339934e34c3629dd0b5', 'request_id': 'req-bbbee035-9ddb-48c8-86ce-834bcfac17f9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.752896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] The token cache is being invalidate because project 2723afb18b8e4339934e34c3629dd0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:50.753195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.753893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:50.755855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1051/2108] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:50 2022] DELETE /identity/v3/projects/2723afb18b8e4339934e34c3629dd0b5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:50.757014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:50.758570 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.773016 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] MFA Rules not processed for user `7eb68564ae3f422896093079dedf1d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:50.775364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.906106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbee035-9ddb-48c8-86ce-834bcfac17f9 tempest-VolumeQuotaClassesTest-521083338 tempest-VolumeQuotaClassesTest-521083338-project-admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:50.911521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:50.912413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:50.912898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:50.913366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:50.915486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:50.953021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1058/2109] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:51.001989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:51.005831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:51.007638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:51.018058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.047981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1052/2110] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:51.048910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:51.056458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.057857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51834a-9bd4-4407-85cf-892e66f9fbaf None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:51.078592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:51.086761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:51.087062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:51.087787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:51.092936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.126393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:51.136018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:51.164247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4e7f2-b8b4-4f66-87d6-ad3bed11bea2 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:51.166032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1059/2111] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:51.170137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:51.170806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:51.171283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:51.171561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:51.174266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.294568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:51.295962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:51.306958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1053/2112] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:51.530276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:51.532150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.552107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f0f97-ff8e-455e-8e06-cc3235db5f19 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:51.559565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:51.560667 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:51.562537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:51.562865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] PATH_INFO: `/v3/users/c37952b327e74818a03d5ae6cf540401` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:51.564491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37952b327e74818a03d5ae6cf540401)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:51.566928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:51.615857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:51.617914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.669420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da829-2b75-4934-b6b5-6e5bfdcaa60f service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:51.676319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:51.677397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:51.677686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:51.679176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] PATH_INFO: `/v3/projects/6398a076a52145ca9bcca22e1521cc22` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:51.682723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6398a076a52145ca9bcca22e1521cc22)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:51.687526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:51.698591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37952b327e74818a03d5ae6cf540401'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.722405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37952b327e74818a03d5ae6cf540401'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.723311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37952b327e74818a03d5ae6cf540401'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.755327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37952b327e74818a03d5ae6cf540401'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.756151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-77b3fd27-15c2-4622-88df-71ab9dcfb0a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37952b327e74818a03d5ae6cf540401'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.808166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1060/2113] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:51 2022] DELETE /identity/v3/users/c37952b327e74818a03d5ae6cf540401 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:51.810539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:51.810808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:51.811288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:51.829404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6398a076a52145ca9bcca22e1521cc22', 'request_id': 'req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.834295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:51.835659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.838654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6398a076a52145ca9bcca22e1521cc22', 'request_id': 'req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.849856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6398a076a52145ca9bcca22e1521cc22', 'request_id': 'req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.866054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] The token cache is being invalidate because project 6398a076a52145ca9bcca22e1521cc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:51.866346 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.867813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:51.870400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1054/2114] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:51 2022] DELETE /identity/v3/projects/6398a076a52145ca9bcca22e1521cc22 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:51.874669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:51.876783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.954703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394b7d2-bb5f-49e6-b8dd-b5b6deaed21a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:51.960166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1061/2115] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:51.961373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:51.961505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:51.962401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:51.962688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:51.962965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] PATH_INFO: `/v3/users/70ee25b4010244c19e1d546c81f71ba5` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:51.963060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:51.964196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ee25b4010244c19e1d546c81f71ba5)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:51.966806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:51.975945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0adb1-10bb-4b29-bf16-533d2e5d9c4a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:51.993027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:51.994473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:51.994651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:51.994941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] PATH_INFO: `/v3/projects/8df6e60ae2114b50bfbddefebf379d71` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:51.996549 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df6e60ae2114b50bfbddefebf379d71)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:51.998532 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:52.035411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ee25b4010244c19e1d546c81f71ba5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.046293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ee25b4010244c19e1d546c81f71ba5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.047244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ee25b4010244c19e1d546c81f71ba5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.066539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ee25b4010244c19e1d546c81f71ba5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.067235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ee25b4010244c19e1d546c81f71ba5'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.081025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df6e60ae2114b50bfbddefebf379d71', 'request_id': 'req-41a3e312-2bea-4d14-84e5-2bf25cd852d3'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.094087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1055/2116] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:51 2022] DELETE /identity/v3/users/70ee25b4010244c19e1d546c81f71ba5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:52.094290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df6e60ae2114b50bfbddefebf379d71', 'request_id': 'req-41a3e312-2bea-4d14-84e5-2bf25cd852d3'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.094390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:52.094390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:52.098373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df6e60ae2114b50bfbddefebf379d71', 'request_id': 'req-41a3e312-2bea-4d14-84e5-2bf25cd852d3'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.109494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] The token cache is being invalidate because project 8df6e60ae2114b50bfbddefebf379d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:52.109830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.110876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.112932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1062/2117] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:51 2022] DELETE /identity/v3/projects/8df6e60ae2114b50bfbddefebf379d71 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:52.118463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:52.121622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:52.180723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd07e4b-89c8-44ba-83c8-1a40a8f186e5 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:52.185914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:52.186768 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:52.187057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:52.187520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:52.189643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:52.269077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e312-2bea-4d14-84e5-2bf25cd852d3 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:52.284268 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:52.285795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:52.309244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1056/2118] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:52.336818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:52.337719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:52.338004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:52.338277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] PATH_INFO: `/v3/users/4d3903531c8f4ac7a620a1ebb805f8f2` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:52.339474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3903531c8f4ac7a620a1ebb805f8f2)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:52.342036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:52.393343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3903531c8f4ac7a620a1ebb805f8f2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.406089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3903531c8f4ac7a620a1ebb805f8f2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.407069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3903531c8f4ac7a620a1ebb805f8f2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.420311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3903531c8f4ac7a620a1ebb805f8f2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.421089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-68b63fe9-1c5c-4227-a067-b83e557be780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3903531c8f4ac7a620a1ebb805f8f2'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.441908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1063/2119] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:52 2022] DELETE /identity/v3/users/4d3903531c8f4ac7a620a1ebb805f8f2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:52.531193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:52.532729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:52.545505 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd505ee-4f0b-44ad-b041-a229b8625e6f service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:52.603919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:52.604993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:52.605341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:52.605785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] PATH_INFO: `/v3/projects/31a001b5df30422b84858bcb468eab09` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:52.607007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a001b5df30422b84858bcb468eab09)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:52.609025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:52.660041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a001b5df30422b84858bcb468eab09', 'request_id': 'req-305e2066-953d-442d-a9ae-8392bc312d37'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.667923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a001b5df30422b84858bcb468eab09', 'request_id': 'req-305e2066-953d-442d-a9ae-8392bc312d37'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.675525 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a001b5df30422b84858bcb468eab09', 'request_id': 'req-305e2066-953d-442d-a9ae-8392bc312d37'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.691351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] The token cache is being invalidate because project 31a001b5df30422b84858bcb468eab09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:52.692596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.693446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.699910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1057/2120] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:52 2022] DELETE /identity/v3/projects/31a001b5df30422b84858bcb468eab09 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:52.701300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a240a2-ba47-4d4b-ae50-bf6f36cab25d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:52.702188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a240a2-ba47-4d4b-ae50-bf6f36cab25d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:52.702630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a240a2-ba47-4d4b-ae50-bf6f36cab25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:52.723110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-50a240a2-ba47-4d4b-ae50-bf6f36cab25d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:52.724772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-50a240a2-ba47-4d4b-ae50-bf6f36cab25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:52.813177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:52.814854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1064/2121] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:52.816729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108dab6-f403-4cf9-857b-e3c843522422 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:52.817024 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108dab6-f403-4cf9-857b-e3c843522422 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:52.817312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108dab6-f403-4cf9-857b-e3c843522422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:52.818297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:52.840159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2108dab6-f403-4cf9-857b-e3c843522422 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:52.842310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2108dab6-f403-4cf9-857b-e3c843522422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:52.852937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e2066-953d-442d-a9ae-8392bc312d37 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:52.853671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1065/2122] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:52.858860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108dab6-f403-4cf9-857b-e3c843522422 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:52.868970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:52.870134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:52.870572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:52.871861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] PATH_INFO: `/v3/projects/52f9be0b3f2a49a09e32724649704f64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:52.875942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108dab6-f403-4cf9-857b-e3c843522422 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:52.877903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f9be0b3f2a49a09e32724649704f64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:52.879900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:52.891702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:52.892870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:52.893370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:52.895147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:52.896114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:52.897090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:52.899327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:52.916643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1066/2123] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:45:52.921808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:52.934394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ac0c5-5bc7-4f63-b460-1ba509a20e2f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:52.954064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f9be0b3f2a49a09e32724649704f64', 'request_id': 'req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.967761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f9be0b3f2a49a09e32724649704f64', 'request_id': 'req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.975545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f9be0b3f2a49a09e32724649704f64', 'request_id': 'req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.987863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] The token cache is being invalidate because project 52f9be0b3f2a49a09e32724649704f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:52.988204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.988960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:52.995668 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1058/2124] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:52 2022] DELETE /identity/v3/projects/52f9be0b3f2a49a09e32724649704f64 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:52.995668 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.008587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.064365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.065031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.065315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.065593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.067021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.069208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.097195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523665-f5a5-4fe5-9805-a9548d3dfcfc admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.104885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.105905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.106083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.106409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] PATH_INFO: `/v3/projects/50c3de6807504c3e9abfd634b7262df5` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.108645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c3de6807504c3e9abfd634b7262df5)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.110889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.111066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1067/2125] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:52 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:53.112699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.121688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.194158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c3de6807504c3e9abfd634b7262df5', 'request_id': 'req-b78e5d9c-eb5d-4748-82fb-b241975675de'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.194699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694926b2-a604-46e8-8935-7433dfce3fed admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.205019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c3de6807504c3e9abfd634b7262df5', 'request_id': 'req-b78e5d9c-eb5d-4748-82fb-b241975675de'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.219327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c3de6807504c3e9abfd634b7262df5', 'request_id': 'req-b78e5d9c-eb5d-4748-82fb-b241975675de'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.232223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] The token cache is being invalidate because project 50c3de6807504c3e9abfd634b7262df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:53.232589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.233530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.241801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1059/2126] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:52 2022] DELETE /identity/v3/projects/50c3de6807504c3e9abfd634b7262df5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:53.241801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.243881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.268010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.269366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.269937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.269937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] PATH_INFO: `/v3/users/f9df11e005f948dbbb12fc432df1489b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.271422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9df11e005f948dbbb12fc432df1489b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.273417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.342695 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9df11e005f948dbbb12fc432df1489b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.355379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9df11e005f948dbbb12fc432df1489b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.357067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9df11e005f948dbbb12fc432df1489b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.375487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e5d9c-eb5d-4748-82fb-b241975675de admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.381476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.382495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.382804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.383133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.383966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.386701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.389113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9df11e005f948dbbb12fc432df1489b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.390460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0e9e7187-1e97-4818-b32c-e20d175cc574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9df11e005f948dbbb12fc432df1489b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.414963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1068/2127] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:53 2022] DELETE /identity/v3/users/f9df11e005f948dbbb12fc432df1489b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:53.416281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232fc77-b47e-460d-a8d8-6fee3f3394d8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.416569 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232fc77-b47e-460d-a8d8-6fee3f3394d8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.416846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232fc77-b47e-460d-a8d8-6fee3f3394d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.430653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1060/2128] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:53.431596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.433373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.448860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30fc63-1b63-4639-8b6a-d797a95d6467 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.449785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2232fc77-b47e-460d-a8d8-6fee3f3394d8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:53.451140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2232fc77-b47e-460d-a8d8-6fee3f3394d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.531921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e482c7-2b38-41fb-b3f2-8f900df23064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.532884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e482c7-2b38-41fb-b3f2-8f900df23064 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.533368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e482c7-2b38-41fb-b3f2-8f900df23064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.533845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e482c7-2b38-41fb-b3f2-8f900df23064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.534718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e482c7-2b38-41fb-b3f2-8f900df23064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.537460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e482c7-2b38-41fb-b3f2-8f900df23064 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.550084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1069/2129] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:53.550293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1061/2130] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:53.554207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232fc77-b47e-460d-a8d8-6fee3f3394d8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.554887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5aa57-7b01-47cb-ab5a-25978e94aad8 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.555239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5aa57-7b01-47cb-ab5a-25978e94aad8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.555874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5aa57-7b01-47cb-ab5a-25978e94aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.580264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232fc77-b47e-460d-a8d8-6fee3f3394d8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.583313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4cf5aa57-7b01-47cb-ab5a-25978e94aad8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:53.584972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4cf5aa57-7b01-47cb-ab5a-25978e94aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.590114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.592092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.592633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.592923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.593680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.594546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1062/2131] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:53.597937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.598946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5aa57-7b01-47cb-ab5a-25978e94aad8 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.608574 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5aa57-7b01-47cb-ab5a-25978e94aad8 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.615069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.615069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.615069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.615069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.615874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1070/2132] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:53.615987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:53.616338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.617450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.618509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.632103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1063/2133] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:53.633482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6fa2-01d3-4867-b59a-c648c4a76b7b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.636530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.640265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140828a-9bd2-46a7-a79b-ea3f7b5dc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.641335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140828a-9bd2-46a7-a79b-ea3f7b5dc6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.641828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140828a-9bd2-46a7-a79b-ea3f7b5dc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.642258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140828a-9bd2-46a7-a79b-ea3f7b5dc6e3 admin admin] PATH_INFO: `/v3/projects/b3680e10193b468a8a05ea312b5ef7d0/users/6c43ff5484ae4998a1fab7242b110c21/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.649524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1738-60a9-4866-9533-e5628b93650b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.655186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.656715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.656879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.657235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.658349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.661464 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.670120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140828a-9bd2-46a7-a79b-ea3f7b5dc6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3680e10193b468a8a05ea312b5ef7d0, user_id=6c43ff5484ae4998a1fab7242b110c21, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.674254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140828a-9bd2-46a7-a79b-ea3f7b5dc6e3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.694947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1071/2134] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:53 2022] PUT /identity/v3/projects/b3680e10193b468a8a05ea312b5ef7d0/users/6c43ff5484ae4998a1fab7242b110c21/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:53.706715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02024-a0df-41d9-b938-4f11da6203f8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.707054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02024-a0df-41d9-b938-4f11da6203f8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.707530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02024-a0df-41d9-b938-4f11da6203f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.709815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1064/2135] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:53.716954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.742212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-68f02024-a0df-41d9-b938-4f11da6203f8 None None] MFA Rules not processed for user `6c43ff5484ae4998a1fab7242b110c21`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:53.743749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-68f02024-a0df-41d9-b938-4f11da6203f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.809186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907adfa-6c83-4cbc-a593-960e2357cc18 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.816048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.817027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.817533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.817982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.818730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.821338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.834023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1072/2136] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:53.838487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02024-a0df-41d9-b938-4f11da6203f8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.862794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02024-a0df-41d9-b938-4f11da6203f8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.865998 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1065/2137] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/users => generated 305 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:53.868409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.870223 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.871337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.872217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.872499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.872772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.880572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.883128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.883787 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194657c-ce7d-4852-b75f-767900e3e5d0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:53.890049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:53.890906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:53.891189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:53.891495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] PATH_INFO: `/v3/projects/d6696f246e0d4e668f1eca55c8f25f57` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:53.892682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6696f246e0d4e668f1eca55c8f25f57)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:53.894894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:53.913203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1073/2138] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:45:53.917971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.947280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6696f246e0d4e668f1eca55c8f25f57', 'request_id': 'req-4f8775f5-c920-453e-a167-e76f05a41baf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.956523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6696f246e0d4e668f1eca55c8f25f57', 'request_id': 'req-4f8775f5-c920-453e-a167-e76f05a41baf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.963592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6696f246e0d4e668f1eca55c8f25f57', 'request_id': 'req-4f8775f5-c920-453e-a167-e76f05a41baf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.975969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] The token cache is being invalidate because project d6696f246e0d4e668f1eca55c8f25f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:53.976603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.977544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:53.984813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1066/2139] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:53 2022] DELETE /identity/v3/projects/d6696f246e0d4e668f1eca55c8f25f57 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:53.984813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:53.984813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:53.988926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3173d-3464-40d2-b71a-969321e84dba admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.047198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4e9a6-273e-42e7-bdf2-9f55b412414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.047868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4e9a6-273e-42e7-bdf2-9f55b412414f admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.048176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4e9a6-273e-42e7-bdf2-9f55b412414f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.048452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4e9a6-273e-42e7-bdf2-9f55b412414f admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.049181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4e9a6-273e-42e7-bdf2-9f55b412414f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.050996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4e9a6-273e-42e7-bdf2-9f55b412414f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.061590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1074/2140] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:54.063367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.063367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.063558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.064918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8775f5-c920-453e-a167-e76f05a41baf admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.070460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52116965-d5d7-4bad-9c1c-ee775ce498d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.071913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116965-d5d7-4bad-9c1c-ee775ce498d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.072193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116965-d5d7-4bad-9c1c-ee775ce498d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.072467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116965-d5d7-4bad-9c1c-ee775ce498d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.073159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52116965-d5d7-4bad-9c1c-ee775ce498d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.075169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52116965-d5d7-4bad-9c1c-ee775ce498d8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.083635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:54.085764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.095172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1075/2141] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:54.095921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.097153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.104129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1067/2142] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:53 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:54.105878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387f7d-8f3d-4442-9f6d-ec20175d88d9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.106350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387f7d-8f3d-4442-9f6d-ec20175d88d9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.107409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387f7d-8f3d-4442-9f6d-ec20175d88d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.113404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c1f31-004e-4716-8d51-f643d8da0658 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.136605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c9387f7d-8f3d-4442-9f6d-ec20175d88d9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:54.136878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.136878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.136878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.136878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.137561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c9387f7d-8f3d-4442-9f6d-ec20175d88d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.137974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.139840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.150204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1068/2143] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:54.150204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9387f7d-8f3d-4442-9f6d-ec20175d88d9 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.158408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1076/2144] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:54.158784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.164022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.165229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9387f7d-8f3d-4442-9f6d-ec20175d88d9 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.170403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.171220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.171504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.171774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.172503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.174147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.177605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb122-d838-4347-9e49-289cce166b1e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.182298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.183148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.183430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.183709 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] PATH_INFO: `/v3/users/dbec557b65e44387afcd5b2e9c20e83f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.184550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1069/2145] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:54.184924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbec557b65e44387afcd5b2e9c20e83f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.185415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.186996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.198899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b5f0-00bb-4fa3-9832-a40d2ececaf8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.204728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.205628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.206852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.207265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.208481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:54.208925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.210563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.228387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1070/2146] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:54.229084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.239736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8e52c-5647-441b-b824-cac055dbac82 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.244191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbec557b65e44387afcd5b2e9c20e83f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:54.244413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.245286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.245564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.245862 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] PATH_INFO: `/v3/projects/cefc5430ba0842c3a9a05b0ab4049ea3/users/0747ff9375e04a42a5ac49de0059e8d2/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.252779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbec557b65e44387afcd5b2e9c20e83f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:54.253447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbec557b65e44387afcd5b2e9c20e83f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:54.262425 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefc5430ba0842c3a9a05b0ab4049ea3, user_id=0747ff9375e04a42a5ac49de0059e8d2, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.265688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.267845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbec557b65e44387afcd5b2e9c20e83f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:54.268698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbec557b65e44387afcd5b2e9c20e83f'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:54.283098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1071/2147] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:54 2022] PUT /identity/v3/projects/cefc5430ba0842c3a9a05b0ab4049ea3/users/0747ff9375e04a42a5ac49de0059e8d2/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:54.283411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1077/2148] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:54 2022] DELETE /identity/v3/users/dbec557b65e44387afcd5b2e9c20e83f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:54.284365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.285230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.286234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.286723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.361550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3798d-7f48-4e50-b089-32994f306fac admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.366775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce975b7-9a55-4604-8139-222743e11934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.367699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce975b7-9a55-4604-8139-222743e11934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.368108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce975b7-9a55-4604-8139-222743e11934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.368395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce975b7-9a55-4604-8139-222743e11934 admin admin] PATH_INFO: `/v3/projects/f799453ce0dc49728a4489367a9b6e94/users/fb8128a3a8ad4ef6b9435eedf9fae32b/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.370335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417895e1-a63e-40a1-935e-cea675e61358 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.376478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1ed7-227f-49f9-ab51-a1441ef3c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.377288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1ed7-227f-49f9-ab51-a1441ef3c96a admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.377668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1ed7-227f-49f9-ab51-a1441ef3c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.378725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1ed7-227f-49f9-ab51-a1441ef3c96a admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.379531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1ed7-227f-49f9-ab51-a1441ef3c96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.381617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1ed7-227f-49f9-ab51-a1441ef3c96a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.389693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce975b7-9a55-4604-8139-222743e11934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799453ce0dc49728a4489367a9b6e94, user_id=fb8128a3a8ad4ef6b9435eedf9fae32b, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.392378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce975b7-9a55-4604-8139-222743e11934 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.409661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1072/2149] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:54 2022] PUT /identity/v3/projects/f799453ce0dc49728a4489367a9b6e94/users/fb8128a3a8ad4ef6b9435eedf9fae32b/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:54.413566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40f5b-1875-45cb-b40c-30171e609915 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.413887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40f5b-1875-45cb-b40c-30171e609915 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.414168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40f5b-1875-45cb-b40c-30171e609915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.428189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1078/2150] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:54.429343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9656-bd5e-4ad7-997c-30c44a27cfb3 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.429631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9656-bd5e-4ad7-997c-30c44a27cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.429951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9656-bd5e-4ad7-997c-30c44a27cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.453376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9ea40f5b-1875-45cb-b40c-30171e609915 None None] MFA Rules not processed for user `0747ff9375e04a42a5ac49de0059e8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:54.455256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-32be9656-bd5e-4ad7-997c-30c44a27cfb3 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:54.456464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-32be9656-bd5e-4ad7-997c-30c44a27cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.458391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9ea40f5b-1875-45cb-b40c-30171e609915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.536688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1079/2151] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:54.538132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be9656-bd5e-4ad7-997c-30c44a27cfb3 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.549966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be9656-bd5e-4ad7-997c-30c44a27cfb3 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.560278 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1073/2152] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:54.560278 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea40f5b-1875-45cb-b40c-30171e609915 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.562005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.562934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.563224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.563502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.564241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.565895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.569547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea40f5b-1875-45cb-b40c-30171e609915 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.574541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.575747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.576029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.576298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.577399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.579415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.581823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1080/2153] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:54.581823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.583666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.607071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1074/2154] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:54.608533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.614918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:54.627851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d37c9-2a58-49a4-bc0d-99ab0b1cb505 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.633603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.634383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.634734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.635119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.635892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.638576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.671736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648662b-e2f2-4b15-9b12-62c234d6acb9 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.674929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1075/2155] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/projects => generated 407 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:54.675885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.731157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.732031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.732307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.732571 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.763707 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e61c1-7231-4fc1-b261-29884872c471 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.768832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.769823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.770167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.770492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] PATH_INFO: `/v3/projects/f799453ce0dc49728a4489367a9b6e94/users/fb8128a3a8ad4ef6b9435eedf9fae32b/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.773339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799453ce0dc49728a4489367a9b6e94, user_id=fb8128a3a8ad4ef6b9435eedf9fae32b, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.777052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.788902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1076/2156] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:54 2022] PUT /identity/v3/projects/f799453ce0dc49728a4489367a9b6e94/users/fb8128a3a8ad4ef6b9435eedf9fae32b/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:54.800814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.826397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.828853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.843871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1081/2157] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:54.845352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:54.857210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c181460-9761-4741-b9b6-1ecd860898ff service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.894372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3c3c-240c-41e1-a93e-4206103b1896 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:54.908035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ff2bd-0179-412d-ac22-cea39f032545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.908866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ff2bd-0179-412d-ac22-cea39f032545 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.909281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ff2bd-0179-412d-ac22-cea39f032545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.909560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ff2bd-0179-412d-ac22-cea39f032545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.911290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ff2bd-0179-412d-ac22-cea39f032545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.913859 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ff2bd-0179-412d-ac22-cea39f032545 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.927064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1077/2158] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:54.928563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61bd71-9f0d-44c0-8b2e-6a12aeefba60 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.929397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61bd71-9f0d-44c0-8b2e-6a12aeefba60 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.930039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61bd71-9f0d-44c0-8b2e-6a12aeefba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.964036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:54.964722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:54.965009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:54.965289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:54.966981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:54.969165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:54.971499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ef61bd71-9f0d-44c0-8b2e-6a12aeefba60 None None] MFA Rules not processed for user `fb8128a3a8ad4ef6b9435eedf9fae32b`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:54.973548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ef61bd71-9f0d-44c0-8b2e-6a12aeefba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.009743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1082/2159] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/users => generated 310 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:55.010966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.031382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82680a6-ba1b-4a20-ac6b-3fac00800b3a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.038764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.039461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.039803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.040088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.041378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.043768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.062649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1083/2160] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:55.064067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.075787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a08ee-0de1-486e-b3bf-3b3ab4e79d0f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.083302 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.084539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.084885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.085172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.085955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.087932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.101491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1078/2161] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:55.105041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61bd71-9f0d-44c0-8b2e-6a12aeefba60 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.105173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1084/2162] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:55.113835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.136326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61bd71-9f0d-44c0-8b2e-6a12aeefba60 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.138090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a3cc-7f05-4724-b883-4f909de6639a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.144498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.145423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.145719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.147440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] PATH_INFO: `/v3/projects/b4c4b2de44b146b9b31831a7389caeb4/users/9692ee1a77774e3480e32a74a4bd3735/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.147573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782640c-a567-478b-9592-9e26336c2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.153997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782640c-a567-478b-9592-9e26336c2366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.154454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782640c-a567-478b-9592-9e26336c2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.154914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782640c-a567-478b-9592-9e26336c2366 admin admin] PATH_INFO: `/v3/projects/dcffe019d17449aca3e8b35dcda57946/users/e7fadda363554d3b8510fa252726c70a/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.187568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c4b2de44b146b9b31831a7389caeb4, user_id=9692ee1a77774e3480e32a74a4bd3735, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.192030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.195623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782640c-a567-478b-9592-9e26336c2366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcffe019d17449aca3e8b35dcda57946, user_id=e7fadda363554d3b8510fa252726c70a, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.198498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782640c-a567-478b-9592-9e26336c2366 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.219007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1079/2163] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:55 2022] PUT /identity/v3/projects/b4c4b2de44b146b9b31831a7389caeb4/users/9692ee1a77774e3480e32a74a4bd3735/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:55.220605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.230495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.235738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1085/2164] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:55 2022] PUT /identity/v3/projects/dcffe019d17449aca3e8b35dcda57946/users/e7fadda363554d3b8510fa252726c70a/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:55.235738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1838-e97d-4bd9-8941-87b5a07aa1e2 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.235738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1838-e97d-4bd9-8941-87b5a07aa1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.235738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1838-e97d-4bd9-8941-87b5a07aa1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.280780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-06dd1838-e97d-4bd9-8941-87b5a07aa1e2 None None] MFA Rules not processed for user `9692ee1a77774e3480e32a74a4bd3735`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:55.283001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-06dd1838-e97d-4bd9-8941-87b5a07aa1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.356894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402d165-12b4-4f1a-96c1-785848a41d62 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.418139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1086/2165] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:55.418615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1838-e97d-4bd9-8941-87b5a07aa1e2 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.437423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.440399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.441155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.441155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.446334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.493162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1838-e97d-4bd9-8941-87b5a07aa1e2 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.498201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.498891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.499147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.499423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.500154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.502098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.515465 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.518042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.520082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1087/2166] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:55.521131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.523128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.538775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6bd64-1f52-4031-b2e5-149dfbb40fc7 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.539051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1080/2167] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:55.540187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.543644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.545113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.545236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.545458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.545827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] PATH_INFO: `/v3/projects/bbb524eba1034ac1b411f94e1f4beedb` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.547291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb524eba1034ac1b411f94e1f4beedb)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.549350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.565511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb501e7-6a1b-40b6-848f-2834821f5d56 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.570409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.571709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.571709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.572085 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] PATH_INFO: `/v3/users/3fc5418744ce43cf8074de1d2f0de6cf` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.573511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc5418744ce43cf8074de1d2f0de6cf)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.575540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.638373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb524eba1034ac1b411f94e1f4beedb', 'request_id': 'req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.641987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc5418744ce43cf8074de1d2f0de6cf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.650585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb524eba1034ac1b411f94e1f4beedb', 'request_id': 'req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.655664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc5418744ce43cf8074de1d2f0de6cf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.656713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc5418744ce43cf8074de1d2f0de6cf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.661832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb524eba1034ac1b411f94e1f4beedb', 'request_id': 'req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.679971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc5418744ce43cf8074de1d2f0de6cf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.680866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc5418744ce43cf8074de1d2f0de6cf'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.681012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] The token cache is being invalidate because project bbb524eba1034ac1b411f94e1f4beedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:55.681308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.682007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:55.686612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1088/2168] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:55 2022] DELETE /identity/v3/projects/bbb524eba1034ac1b411f94e1f4beedb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:55.686612 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.687426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.707229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1081/2169] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:55 2022] DELETE /identity/v3/users/3fc5418744ce43cf8074de1d2f0de6cf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:55.709228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.729356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.809060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4a73-213a-4052-b6d1-3eb2c69d4a0d admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.843484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9626e-2259-4c22-8b3c-30269d3eb1f3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.850639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.851663 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.853046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.853411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] PATH_INFO: `/v3/projects/dcffe019d17449aca3e8b35dcda57946/users/e7fadda363554d3b8510fa252726c70a/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.855956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcffe019d17449aca3e8b35dcda57946, user_id=e7fadda363554d3b8510fa252726c70a, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.859536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.872866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1082/2170] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:55 2022] PUT /identity/v3/projects/dcffe019d17449aca3e8b35dcda57946/users/e7fadda363554d3b8510fa252726c70a/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:55.873838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:55.875525 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:55.886773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053ddc6-149c-4ae4-bb67-e13c424a3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:55.888513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053ddc6-149c-4ae4-bb67-e13c424a3e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.888723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053ddc6-149c-4ae4-bb67-e13c424a3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.889040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053ddc6-149c-4ae4-bb67-e13c424a3e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.889990 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053ddc6-149c-4ae4-bb67-e13c424a3e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:55.892701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053ddc6-149c-4ae4-bb67-e13c424a3e8f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:55.925647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1089/2171] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:55 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:55.930430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673404-ece5-4e0b-8396-5604472e5e5b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:55.930884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673404-ece5-4e0b-8396-5604472e5e5b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:55.931271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673404-ece5-4e0b-8396-5604472e5e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:55.967956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7fe6d-8c30-4288-b8b4-5123733b9f5e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:55.984673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0c673404-ece5-4e0b-8396-5604472e5e5b None None] MFA Rules not processed for user `e7fadda363554d3b8510fa252726c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:55.986299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0c673404-ece5-4e0b-8396-5604472e5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.036682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.037976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.038325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.038584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] PATH_INFO: `/v3/users/7eb68564ae3f422896093079dedf1d18` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.040183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb68564ae3f422896093079dedf1d18)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.043030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.105854 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1090/2172] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:56.113878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb68564ae3f422896093079dedf1d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.114279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c673404-ece5-4e0b-8396-5604472e5e5b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.122148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb68564ae3f422896093079dedf1d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.123098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb68564ae3f422896093079dedf1d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.125438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c673404-ece5-4e0b-8396-5604472e5e5b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.130338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.131111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.131464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.131823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.132600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.134665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.135588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb68564ae3f422896093079dedf1d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.136373 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb68564ae3f422896093079dedf1d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.156512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1083/2173] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:45:55 2022] DELETE /identity/v3/users/7eb68564ae3f422896093079dedf1d18 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:56.157513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.158845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.167245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1091/2174] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:56 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:56.174015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.176419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.192622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea70fc-39f1-4d08-80e9-6285a1d65f24 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.260501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b336-3f28-48a1-96db-c1df881d6a8e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.266353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.267480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.267480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.267773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.269692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.281560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.282356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.282702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.283043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.284102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.286401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.302519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1092/2175] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:45:56.303524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.305663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.321222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f3fc-e816-4796-b5f3-9c63ac25d098 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.328717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.329769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.330180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.330604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] PATH_INFO: `/v3/projects/4b52f1a625344430ba655dc6c40eebb3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.331868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b52f1a625344430ba655dc6c40eebb3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.333919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.350621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.351889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.367014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1084/2176] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:56.368929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.391288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48382dbd-742c-48a4-ad60-5e44943105af service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.407193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b52f1a625344430ba655dc6c40eebb3', 'request_id': 'req-5a5a3286-0c32-4254-9ecf-284751ef9f8a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.415380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b52f1a625344430ba655dc6c40eebb3', 'request_id': 'req-5a5a3286-0c32-4254-9ecf-284751ef9f8a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.439259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b52f1a625344430ba655dc6c40eebb3', 'request_id': 'req-5a5a3286-0c32-4254-9ecf-284751ef9f8a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.469153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] The token cache is being invalidate because project 4b52f1a625344430ba655dc6c40eebb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:56.469444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.471000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5a5a3286-0c32-4254-9ecf-284751ef9f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.476059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1093/2177] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:56 2022] DELETE /identity/v3/projects/4b52f1a625344430ba655dc6c40eebb3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:56.477305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2bb0-a70a-43ee-a797-a8d71864699c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.477591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2bb0-a70a-43ee-a797-a8d71864699c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.478422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2bb0-a70a-43ee-a797-a8d71864699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.492548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.493535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.493535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.493807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.494547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.496335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.500438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-48ba2bb0-a70a-43ee-a797-a8d71864699c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:56.501890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-48ba2bb0-a70a-43ee-a797-a8d71864699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.513627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1094/2178] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:56.521314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1085/2179] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:56.523282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1344f41-acfb-44e3-90a9-fdee212120f0 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.523574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1344f41-acfb-44e3-90a9-fdee212120f0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.523841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1344f41-acfb-44e3-90a9-fdee212120f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.524304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.527928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.543423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0688e67-a360-4aa7-867f-10fb4fe5a60a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.546619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e1344f41-acfb-44e3-90a9-fdee212120f0 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:56.547958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e1344f41-acfb-44e3-90a9-fdee212120f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.549744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.550673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.550958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.551236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] PATH_INFO: `/v3/projects/daeee2b2288f4e0882449992b19f4812/users/19e6e51a9e8b496c90b10bcd7dd27a1e/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.558004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1095/2180] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:56.563212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1344f41-acfb-44e3-90a9-fdee212120f0 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.568397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeee2b2288f4e0882449992b19f4812, user_id=19e6e51a9e8b496c90b10bcd7dd27a1e, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.571410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.576238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1344f41-acfb-44e3-90a9-fdee212120f0 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.582548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07f913-e58d-4416-a8c6-c450c0828e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.583395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07f913-e58d-4416-a8c6-c450c0828e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.583686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07f913-e58d-4416-a8c6-c450c0828e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.584135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07f913-e58d-4416-a8c6-c450c0828e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.584883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07f913-e58d-4416-a8c6-c450c0828e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:56.585325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07f913-e58d-4416-a8c6-c450c0828e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.587184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07f913-e58d-4416-a8c6-c450c0828e2d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.588985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1086/2181] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:56 2022] PUT /identity/v3/projects/daeee2b2288f4e0882449992b19f4812/users/19e6e51a9e8b496c90b10bcd7dd27a1e/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:56.599555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.599555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.618050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1096/2182] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:56.619431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.619660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.619936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.650490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] MFA Rules not processed for user `19e6e51a9e8b496c90b10bcd7dd27a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:56.651703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.677015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad44333-2396-41b5-be5c-cea4d428dff0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.681669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.682571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.682853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.683129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] PATH_INFO: `/v3/projects/621f819bd5a148eaaa78fdac75679329` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.684320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621f819bd5a148eaaa78fdac75679329)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.686290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.715463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1097/2183] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:56.716896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.718585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.732608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621f819bd5a148eaaa78fdac75679329', 'request_id': 'req-144460dd-92ac-4987-86ee-cbbd1146ad62'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.739897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621f819bd5a148eaaa78fdac75679329', 'request_id': 'req-144460dd-92ac-4987-86ee-cbbd1146ad62'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.746057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621f819bd5a148eaaa78fdac75679329', 'request_id': 'req-144460dd-92ac-4987-86ee-cbbd1146ad62'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.756460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] The token cache is being invalidate because project 621f819bd5a148eaaa78fdac75679329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:45:56.756740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.757402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:45:56.759015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1087/2184] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:45:56 2022] DELETE /identity/v3/projects/621f819bd5a148eaaa78fdac75679329 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:56.759877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.761489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.773059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f95a1-b640-4499-b93b-f491a0b14003 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.827719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b92aa-f6c6-47fe-bce0-885aad0aa7ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.828774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b92aa-f6c6-47fe-bce0-885aad0aa7ab service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.829135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b92aa-f6c6-47fe-bce0-885aad0aa7ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.829485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b92aa-f6c6-47fe-bce0-885aad0aa7ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.831609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1a8b92aa-f6c6-47fe-bce0-885aad0aa7ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.837063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144460dd-92ac-4987-86ee-cbbd1146ad62 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:56.850361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:56.854317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.854681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.855400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.856546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.858817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.908056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1088/2185] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:56 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:56.908936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:56.914260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:56.932147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b92aa-f6c6-47fe-bce0-885aad0aa7ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:56.933542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b92aa-f6c6-47fe-bce0-885aad0aa7ab service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:56.946087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1098/2186] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:56.947584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80f675-3b21-454c-ac8c-b51a05bc1585 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:56.947795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80f675-3b21-454c-ac8c-b51a05bc1585 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:56.948130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80f675-3b21-454c-ac8c-b51a05bc1585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:56.987966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0b80f675-3b21-454c-ac8c-b51a05bc1585 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:56.989489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0b80f675-3b21-454c-ac8c-b51a05bc1585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:57.001049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1099/2187] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:57.002588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80f675-3b21-454c-ac8c-b51a05bc1585 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.003762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6c0a5-699f-4e39-9029-5b87068a8b32 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.014647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff1331-c933-4fc6-bd47-7adf3e9149ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.015431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1331-c933-4fc6-bd47-7adf3e9149ca admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.015804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1331-c933-4fc6-bd47-7adf3e9149ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.016139 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1331-c933-4fc6-bd47-7adf3e9149ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.016882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff1331-c933-4fc6-bd47-7adf3e9149ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.019729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff1331-c933-4fc6-bd47-7adf3e9149ca admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.022294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80f675-3b21-454c-ac8c-b51a05bc1585 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.030914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.034737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.035180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.035590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.039136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.041394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.072416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1089/2188] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:56 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:57.073901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754f3f-18b4-42f2-8ac3-5d36786f22de None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.074250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754f3f-18b4-42f2-8ac3-5d36786f22de None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.074534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754f3f-18b4-42f2-8ac3-5d36786f22de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.083181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1100/2189] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/users => generated 289 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:57.084074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.103572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-16754f3f-18b4-42f2-8ac3-5d36786f22de None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:57.104042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652112b4-68bb-4440-a8c5-6c172a9d7702 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.105102 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-16754f3f-18b4-42f2-8ac3-5d36786f22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:57.188362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1090/2190] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:57.191599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754f3f-18b4-42f2-8ac3-5d36786f22de None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.198840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.200874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.201413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.201529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754f3f-18b4-42f2-8ac3-5d36786f22de None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.202500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.203586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.206391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.206956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.208258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.208258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.208258 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.208907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.211323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.225755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1091/2191] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:57.225755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.237169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d25f9b-f2ec-4d6d-9c71-923bc56b0a6b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.243483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.244161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.244569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.244851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.245874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:45:57.246094 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.248224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.248520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1101/2192] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:57.249362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.265338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1092/2193] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:45:57.266478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.268687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b944f-2558-469a-9f0b-e7691bd135f4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.275526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.276431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.276757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.277137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.277887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f52799-8015-4323-9a23-1b8f6abcebf3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.278011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.280128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.283323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.283981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.284270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.284539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.285260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.286879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.297739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1102/2194] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:57.297739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.305526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1093/2195] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:57.307438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.312003 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9dc9-3e8c-4f6b-99fb-897a7e02cae6 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.317375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.317964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.318099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.318468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.319115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.321045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.324564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372b6b5-aca1-4e3e-9baa-93e2966e160e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.339529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.340440 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.340743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.341186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] PATH_INFO: `/v3/projects/d51975fc708d49efa56621b0fd19c47f/users/97227abbbafa46f1b0660e3be2ceea70/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.358059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1103/2196] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:57.358585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.371326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51975fc708d49efa56621b0fd19c47f, user_id=97227abbbafa46f1b0660e3be2ceea70, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.375735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.404222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1094/2197] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:57 2022] PUT /identity/v3/projects/d51975fc708d49efa56621b0fd19c47f/users/97227abbbafa46f1b0660e3be2ceea70/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:57.404222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.490600 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae7d2-47aa-4e35-8dce-445dcd621473 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.532119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4066c-3c90-49cf-ad32-95d71009ee87 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.537292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663be8a8-a9a7-4958-b421-c305e3972c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.538042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be8a8-a9a7-4958-b421-c305e3972c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.538371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be8a8-a9a7-4958-b421-c305e3972c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.538650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be8a8-a9a7-4958-b421-c305e3972c9e admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.539489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663be8a8-a9a7-4958-b421-c305e3972c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.541631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663be8a8-a9a7-4958-b421-c305e3972c9e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.568296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1095/2198] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:45:57.569610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec75a8d-22fe-47da-8ab9-f3c8ee1bd499 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.569923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec75a8d-22fe-47da-8ab9-f3c8ee1bd499 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.570197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec75a8d-22fe-47da-8ab9-f3c8ee1bd499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.589284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.590207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.590484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.593891 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] PATH_INFO: `/v3/projects/8fd1541c62b04837a629f3b60201fcfa/users/e9bf3d00fbab4e3581a0b08cd30337ce/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.604682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-cec75a8d-22fe-47da-8ab9-f3c8ee1bd499 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:57.605947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-cec75a8d-22fe-47da-8ab9-f3c8ee1bd499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:57.610826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1541c62b04837a629f3b60201fcfa, user_id=e9bf3d00fbab4e3581a0b08cd30337ce, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.614379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.616038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1096/2199] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:45:57.627622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec75a8d-22fe-47da-8ab9-f3c8ee1bd499 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.643204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1104/2200] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:57 2022] PUT /identity/v3/projects/8fd1541c62b04837a629f3b60201fcfa/users/e9bf3d00fbab4e3581a0b08cd30337ce/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:45:57.649117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.651530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:57.658322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec75a8d-22fe-47da-8ab9-f3c8ee1bd499 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.721157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213a626-42b0-48c6-8378-9eee2eb9f7ad admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.725038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.725729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.726020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.726293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.728661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.729323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.729604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.729911 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.730632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.732420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.735887 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.737310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.743120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1097/2201] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:57.744056 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.748030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1105/2202] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:57.748833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.756953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe822-2cbc-45f3-a7d9-06e9fec5ccd2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.758158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507938e-6aac-486a-a38e-8e1195f8962d service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.761913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.763301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.763414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.763599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.763880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.764023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.764295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.764570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.764676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.765283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.766229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.766919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.777316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1098/2203] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:57.781319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.785749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1106/2204] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:45:57.786676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.791004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70388-3dc4-49d1-ade2-34a8f8799237 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.795722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601649aa-82e4-430c-bbb2-d614fea7581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.796542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b955-7acb-45da-8286-45df0ef8d27d admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:57.796651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601649aa-82e4-430c-bbb2-d614fea7581d admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.796852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601649aa-82e4-430c-bbb2-d614fea7581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.797182 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601649aa-82e4-430c-bbb2-d614fea7581d admin admin] PATH_INFO: `/v3/projects/8fd1541c62b04837a629f3b60201fcfa/users/e9bf3d00fbab4e3581a0b08cd30337ce/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.799149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601649aa-82e4-430c-bbb2-d614fea7581d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1541c62b04837a629f3b60201fcfa, user_id=e9bf3d00fbab4e3581a0b08cd30337ce, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.801313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a5a54-2b60-47e3-9f61-d049a62d4fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:57.801797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601649aa-82e4-430c-bbb2-d614fea7581d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.802213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a5a54-2b60-47e3-9f61-d049a62d4fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.802498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a5a54-2b60-47e3-9f61-d049a62d4fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.802775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a5a54-2b60-47e3-9f61-d049a62d4fd7 admin admin] PATH_INFO: `/v3/projects/c794de542790479fb8c2b4c9448aed59/users/6397a996090d4ca3800c2c7be079203d/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.821806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1099/2205] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:57 2022] PUT /identity/v3/projects/8fd1541c62b04837a629f3b60201fcfa/users/e9bf3d00fbab4e3581a0b08cd30337ce/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:57.827150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a5a54-2b60-47e3-9f61-d049a62d4fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c794de542790479fb8c2b4c9448aed59, user_id=6397a996090d4ca3800c2c7be079203d, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:57.828607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.828966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.829405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.830249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a5a54-2b60-47e3-9f61-d049a62d4fd7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:57.849786 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1107/2206] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:45:57 2022] PUT /identity/v3/projects/c794de542790479fb8c2b4c9448aed59/users/6397a996090d4ca3800c2c7be079203d/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:45:57.859906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] MFA Rules not processed for user `e9bf3d00fbab4e3581a0b08cd30337ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:57.860114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:57.860405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:57.860681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:57.861117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:57.889879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] MFA Rules not processed for user `6397a996090d4ca3800c2c7be079203d`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:45:57.891710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:57.930611 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1100/2207] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:57.942625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.944277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:57.976772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1108/2208] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:45:57.990506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:57.994574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:58.016399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd524ce8-9b76-4d7b-b43e-42b6535ff2ac None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:58.021424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:58.022460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:58.022757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:58.023238 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:58.037356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:58.039341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:58.054009 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1101/2209] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:45:58.070929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905529a1-a0f3-4cab-a94f-caa6162607b2 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:58.077624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fc0cc-7538-45f8-8508-96807ff20bbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7291e3af37548efafd5e4654569677b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:58.078421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fc0cc-7538-45f8-8508-96807ff20bbb service glance] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:58.078781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fc0cc-7538-45f8-8508-96807ff20bbb service glance] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:58.079154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fc0cc-7538-45f8-8508-96807ff20bbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:58.089737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fc0cc-7538-45f8-8508-96807ff20bbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:58.091429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fc0cc-7538-45f8-8508-96807ff20bbb service glance] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:58.107529 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1109/2210] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:45:58.984097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:45:58.988550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:59.011514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d8c6-7263-4bd7-a642-e9ef5c3d9156 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:45:59.017093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:45:59.018567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:45:59.019044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:45:59.019622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:45:59.022037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:45:59.098682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:45:59.100141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:45:59.111745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1102/2211] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:45:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:03.006984 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ef961-9ae2-426f-bbc9-183a9de8595a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:03.008215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ef961-9ae2-426f-bbc9-183a9de8595a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:03.008877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ef961-9ae2-426f-bbc9-183a9de8595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:03.088086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-959ef961-9ae2-426f-bbc9-183a9de8595a None None] MFA Rules not processed for user `97227abbbafa46f1b0660e3be2ceea70`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:03.094476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-959ef961-9ae2-426f-bbc9-183a9de8595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:03.199546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1110/2212] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:03.215092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:03.216582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:03.290519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144661bf-b0fb-468b-aac5-3dca5423f7bd service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:03.296960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582fe9-825e-4fc5-9067-58e3d49d7d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:03.297590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582fe9-825e-4fc5-9067-58e3d49d7d7d service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:03.297898 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582fe9-825e-4fc5-9067-58e3d49d7d7d service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:03.298168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582fe9-825e-4fc5-9067-58e3d49d7d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:03.305937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17582fe9-825e-4fc5-9067-58e3d49d7d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:03.307506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17582fe9-825e-4fc5-9067-58e3d49d7d7d service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:03.316684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1103/2213] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:03.755915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ef961-9ae2-426f-bbc9-183a9de8595a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:03.784522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ef961-9ae2-426f-bbc9-183a9de8595a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:03.788713 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:03.789452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:03.790147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:03.790531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:03.793522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:03.909770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:03.911691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:03.933229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1111/2214] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:05.085533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:05.086272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:05.086719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:05.130359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] MFA Rules not processed for user `97227abbbafa46f1b0660e3be2ceea70`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:05.134995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:05.188793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1104/2215] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:06.042828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:06.054205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587190-b33f-4984-9670-6639bf1bce43 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:06.059743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af487-1100-4bcd-95b3-1853169452ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:06.061935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af487-1100-4bcd-95b3-1853169452ae service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:06.063011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af487-1100-4bcd-95b3-1853169452ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:06.063466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af487-1100-4bcd-95b3-1853169452ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:06.066965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-926af487-1100-4bcd-95b3-1853169452ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:06.175918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926af487-1100-4bcd-95b3-1853169452ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:06.180201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926af487-1100-4bcd-95b3-1853169452ae service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:06.206485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1112/2216] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:06.548660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:06.554397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:06.643747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d922fc-564f-4641-8af3-190be046da65 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:06.649343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:06.651029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:06.651308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:06.651585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] PATH_INFO: `/v3/users/0747ff9375e04a42a5ac49de0059e8d2` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:06.653493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0747ff9375e04a42a5ac49de0059e8d2)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:06.655474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:06.714135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0747ff9375e04a42a5ac49de0059e8d2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:06.722261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0747ff9375e04a42a5ac49de0059e8d2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:06.726088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0747ff9375e04a42a5ac49de0059e8d2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:06.742777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0747ff9375e04a42a5ac49de0059e8d2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:06.743521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0747ff9375e04a42a5ac49de0059e8d2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:06.761287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1105/2217] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:06 2022] DELETE /identity/v3/users/0747ff9375e04a42a5ac49de0059e8d2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:06.766029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0a87-27b9-405d-9cb1-796a3ac107c4 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:06.767409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0a87-27b9-405d-9cb1-796a3ac107c4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:06.767979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0a87-27b9-405d-9cb1-796a3ac107c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:06.796071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-53db0a87-27b9-405d-9cb1-796a3ac107c4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:06.797899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-53db0a87-27b9-405d-9cb1-796a3ac107c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:06.920198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1113/2218] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:06.930920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:06.933584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:07.048470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537693fc-8b78-4e2a-8b09-eabfda435b61 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:07.053480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:07.054504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:07.054926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:07.055342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:07.067577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:07.069209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:07.096867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1106/2219] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:07.106297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:07.107275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:07.107638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:07.131340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:07.133394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:07.255176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1114/2220] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:46:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:07.316070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:07.317533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:07.416659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ada751-a286-476a-8b3d-0dc2aff3945b service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:07.422489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:07.423239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:07.423601 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:07.423948 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:07.433126 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:07.435388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:07.444583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1107/2221] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:46:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:46:07.533420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:07.537450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:07.562587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e6c6a-0832-4c16-8c8b-7e4dc4f3cfa1 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:07.570727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:07.571835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:07.572130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:07.572389 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] PATH_INFO: `/v3/projects/cefc5430ba0842c3a9a05b0ab4049ea3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:07.573963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefc5430ba0842c3a9a05b0ab4049ea3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:07.576894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:07.658781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefc5430ba0842c3a9a05b0ab4049ea3', 'request_id': 'req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.671424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefc5430ba0842c3a9a05b0ab4049ea3', 'request_id': 'req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.679621 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefc5430ba0842c3a9a05b0ab4049ea3', 'request_id': 'req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.692830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] The token cache is being invalidate because project cefc5430ba0842c3a9a05b0ab4049ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:07.693378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.694275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-9b0fc01c-7427-4032-9593-6ecc0ab41ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.698988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1115/2222] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:07 2022] DELETE /identity/v3/projects/cefc5430ba0842c3a9a05b0ab4049ea3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:07.700733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:07.721010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecc7f-5201-417f-b6c1-a97632e33e5a service swift] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:07.847159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:07.848811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:07.848811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:07.848811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] PATH_INFO: `/v3/users/e7fadda363554d3b8510fa252726c70a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:07.849939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fadda363554d3b8510fa252726c70a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:07.853519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:07.951698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fadda363554d3b8510fa252726c70a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.965245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fadda363554d3b8510fa252726c70a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.966921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fadda363554d3b8510fa252726c70a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.984818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fadda363554d3b8510fa252726c70a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:07.986036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fadda363554d3b8510fa252726c70a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:08.009326 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1108/2223] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:07 2022] DELETE /identity/v3/users/e7fadda363554d3b8510fa252726c70a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:08.349474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:08.350069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:08.355063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:08.392744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:08.394294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:08.468247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:08.470602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:08.528491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1116/2224] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 12 11:46:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:08.538070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:08.540237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:08.637793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafde98-1afe-47ac-8b12-e649e6aed7db admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:08.644695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:08.646439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:08.646917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:08.647415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] PATH_INFO: `/v3/projects/dcffe019d17449aca3e8b35dcda57946` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:08.649602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcffe019d17449aca3e8b35dcda57946)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:08.652129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:08.707120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16467c-a04a-47d3-a3b6-bc5ff2b3e57c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:08.714563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd7159-02d8-4a39-9784-cbf6b43c3670 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:08.716235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7159-02d8-4a39-9784-cbf6b43c3670 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:08.717018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7159-02d8-4a39-9784-cbf6b43c3670 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:08.717536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7159-02d8-4a39-9784-cbf6b43c3670 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:08.728707 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd7159-02d8-4a39-9784-cbf6b43c3670 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:08.729471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcffe019d17449aca3e8b35dcda57946', 'request_id': 'req-bd6133cb-f5e7-4001-baaa-8258b4462329'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:08.731267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd7159-02d8-4a39-9784-cbf6b43c3670 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:08.743362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcffe019d17449aca3e8b35dcda57946', 'request_id': 'req-bd6133cb-f5e7-4001-baaa-8258b4462329'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:08.747120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1117/2225] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:46:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:46:08.754160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcffe019d17449aca3e8b35dcda57946', 'request_id': 'req-bd6133cb-f5e7-4001-baaa-8258b4462329'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:08.791812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] The token cache is being invalidate because project dcffe019d17449aca3e8b35dcda57946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:08.792107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:08.794853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6133cb-f5e7-4001-baaa-8258b4462329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:08.805479 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1109/2226] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:08 2022] DELETE /identity/v3/projects/dcffe019d17449aca3e8b35dcda57946 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:08.808856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7fa3-7913-4d64-91b0-c3a13853f7e9 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:08.809520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7fa3-7913-4d64-91b0-c3a13853f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:08.810229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7fa3-7913-4d64-91b0-c3a13853f7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:08.836917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-22cc7fa3-7913-4d64-91b0-c3a13853f7e9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:08.838497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-22cc7fa3-7913-4d64-91b0-c3a13853f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:08.979252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1118/2227] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:08.988086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:08.988714 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:08.989032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.020758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:09.020758 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.036641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1110/2228] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:09.037631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7fa3-7913-4d64-91b0-c3a13853f7e9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.048346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7fa3-7913-4d64-91b0-c3a13853f7e9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.053342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2fc95-146c-458a-b88b-fead120869b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.054550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2fc95-146c-458a-b88b-fead120869b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.055212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2fc95-146c-458a-b88b-fead120869b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.055624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2fc95-146c-458a-b88b-fead120869b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.056626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2fc95-146c-458a-b88b-fead120869b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:46:09.057073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2fc95-146c-458a-b88b-fead120869b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.060326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2fc95-146c-458a-b88b-fead120869b3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.072213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.073727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.083035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1119/2229] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:46:09.084965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6724-50ba-4b05-a362-1445aaa96e25 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.085246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6724-50ba-4b05-a362-1445aaa96e25 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.085515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6724-50ba-4b05-a362-1445aaa96e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.094836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9782e3-9b0b-42ef-b9c2-00c3a892cfad None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.101530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.102700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.103142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.103420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] PATH_INFO: `/v3/users/9692ee1a77774e3480e32a74a4bd3735` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.104652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9692ee1a77774e3480e32a74a4bd3735)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.105429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c29d6724-50ba-4b05-a362-1445aaa96e25 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:09.106840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c29d6724-50ba-4b05-a362-1445aaa96e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.108317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.186011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9692ee1a77774e3480e32a74a4bd3735'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.194962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9692ee1a77774e3480e32a74a4bd3735'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.196471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9692ee1a77774e3480e32a74a4bd3735'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.197466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1120/2230] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:46:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:09.201843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6724-50ba-4b05-a362-1445aaa96e25 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.229402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6724-50ba-4b05-a362-1445aaa96e25 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.235654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9692ee1a77774e3480e32a74a4bd3735'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.236733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9692ee1a77774e3480e32a74a4bd3735'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.240085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.240799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.241130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.241459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.242237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.244762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.256301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1111/2231] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:09 2022] DELETE /identity/v3/users/9692ee1a77774e3480e32a74a4bd3735 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:09.256301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.256301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.284707 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1121/2232] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:09 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:09.285566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.287236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.363209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd3171-9f65-4eda-a74b-560594ef31e9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.372998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549065b-83e8-4ef8-8f85-fbbfcb5fbe04 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.378880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.380265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.380773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.381245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] PATH_INFO: `/v3/users/6c43ff5484ae4998a1fab7242b110c21` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.384212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c43ff5484ae4998a1fab7242b110c21)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.387202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.449190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.449969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.450256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.450537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.452718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.454376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c43ff5484ae4998a1fab7242b110c21'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.466401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c43ff5484ae4998a1fab7242b110c21'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.468469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c43ff5484ae4998a1fab7242b110c21'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.491037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c43ff5484ae4998a1fab7242b110c21'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.493118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8dd04f32-869c-4ff1-8617-2c543c19ed34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c43ff5484ae4998a1fab7242b110c21'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:09.519570 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1122/2233] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:09 2022] DELETE /identity/v3/users/6c43ff5484ae4998a1fab7242b110c21 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:09.530046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6be5-6091-425a-a28e-6bf7aa74cee7 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.530046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6be5-6091-425a-a28e-6bf7aa74cee7 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.530046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6be5-6091-425a-a28e-6bf7aa74cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.538660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.540312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.548546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-67fc6be5-6091-425a-a28e-6bf7aa74cee7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:09.549805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-67fc6be5-6091-425a-a28e-6bf7aa74cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.550000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1112/2234] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:46:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:46:09.550810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.552442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.571371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a775b-94cf-49d7-b8c8-9acc1418c5b6 service swift] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.656727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1123/2235] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:09.658538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.658923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.659214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.679527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.680050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.680353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.680620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.681677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.683309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.695405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:09.697033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.706501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1124/2236] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:09.707321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.708850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.711327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1113/2237] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:09 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:09.721591 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.723658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.737930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c134369-9379-47d3-876b-12b98215086f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.747049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.747727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.748010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.748336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.749128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.751027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.765780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1114/2238] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:09.766958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.770551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:09.788029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c8a7b-12a0-4b7a-abbf-8288f255a9d4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.790189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10197b3-7f74-435f-9b92-cf4becf35e89 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.793866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.794578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.794865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.795071 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.795193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.795724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.796114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.796567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.806909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.807634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.808362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.809622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.821222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1125/2239] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:09.836408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.837095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1115/2240] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:09.862336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927a788-bd96-42a7-b60e-ad04968b67e0 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.880966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce158f74-6c1d-43b8-bd40-79c74097749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.885042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce158f74-6c1d-43b8-bd40-79c74097749a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.885677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce158f74-6c1d-43b8-bd40-79c74097749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.885998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce158f74-6c1d-43b8-bd40-79c74097749a admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.886855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce158f74-6c1d-43b8-bd40-79c74097749a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:09.888487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce158f74-6c1d-43b8-bd40-79c74097749a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:09.908763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1126/2241] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:09.913091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:09.935919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba5eb-589b-42a6-8fff-f6e6dbc781a9 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:09.956710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a57c00-a2e9-4c22-ab1c-50d7f027440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:09.958146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a57c00-a2e9-4c22-ab1c-50d7f027440d admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:09.958578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a57c00-a2e9-4c22-ab1c-50d7f027440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:09.959008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a57c00-a2e9-4c22-ab1c-50d7f027440d admin admin] PATH_INFO: `/v3/projects/d83add10bc914fa2b53b93c94671c2cd/users/47030b2f71c64e8884d1946f4ed2afdd/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:09.998622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a57c00-a2e9-4c22-ab1c-50d7f027440d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83add10bc914fa2b53b93c94671c2cd, user_id=47030b2f71c64e8884d1946f4ed2afdd, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:10.003638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a57c00-a2e9-4c22-ab1c-50d7f027440d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:10.045571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1116/2242] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:09 2022] PUT /identity/v3/projects/d83add10bc914fa2b53b93c94671c2cd/users/47030b2f71c64e8884d1946f4ed2afdd/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:10.045992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:10.046285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:10.046561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:10.081117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:10.083034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:10.194753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1127/2243] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:10.198714 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:10.199092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:10.199848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:10.250297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:10.252784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:10.285872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:10.297600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:10.364749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ffd5-cce2-40ac-a1a5-bda97a386cb2 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:10.369999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:10.371004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:10.371510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:10.375988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:10.390235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:10.394463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:10.410846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1128/2244] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:10.417428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1117/2245] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 12 11:46:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:10.430204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:10.432385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:10.556460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ce80-412d-4d86-addb-139eeca00b03 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:10.557466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:10.558369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:10.559581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:10.559864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:10.575837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:10.577958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:10.582239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:10.583725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:10.596385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1129/2246] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:46:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:46:10.604330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312cf49-057b-4879-935e-0bd7a6201689 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:10.614653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:10.615526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:10.615807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:10.616078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] PATH_INFO: `/v3/projects/b4c4b2de44b146b9b31831a7389caeb4` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:10.617290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c4b2de44b146b9b31831a7389caeb4)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:10.619869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:10.702909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c4b2de44b146b9b31831a7389caeb4', 'request_id': 'req-2c97a080-a688-4716-b0f0-6678f7651413'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.714018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c4b2de44b146b9b31831a7389caeb4', 'request_id': 'req-2c97a080-a688-4716-b0f0-6678f7651413'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.724042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c4b2de44b146b9b31831a7389caeb4', 'request_id': 'req-2c97a080-a688-4716-b0f0-6678f7651413'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.731404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:10.732929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:10.739175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] The token cache is being invalidate because project b4c4b2de44b146b9b31831a7389caeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:10.739678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.740150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.744878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1118/2247] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:10 2022] DELETE /identity/v3/projects/b4c4b2de44b146b9b31831a7389caeb4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:46:10.754271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751069a0-9fae-441f-84d7-498c378dfbbb service swift] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:10.755340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:10.757134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:10.844241 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97a080-a688-4716-b0f0-6678f7651413 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:10.846193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:10.847397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:10.847763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:10.847997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] PATH_INFO: `/v3/projects/b3680e10193b468a8a05ea312b5ef7d0` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:10.849352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3680e10193b468a8a05ea312b5ef7d0)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:10.851479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:10.858874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:10.859922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:10.860211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:10.860488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] PATH_INFO: `/v3/users/19e6e51a9e8b496c90b10bcd7dd27a1e` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:10.862012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e6e51a9e8b496c90b10bcd7dd27a1e)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:10.864081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:10.942998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3680e10193b468a8a05ea312b5ef7d0', 'request_id': 'req-dd57cdd4-6323-4327-a5fd-4cd885c03013'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.961014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3680e10193b468a8a05ea312b5ef7d0', 'request_id': 'req-dd57cdd4-6323-4327-a5fd-4cd885c03013'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.970757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3680e10193b468a8a05ea312b5ef7d0', 'request_id': 'req-dd57cdd4-6323-4327-a5fd-4cd885c03013'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.970932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e6e51a9e8b496c90b10bcd7dd27a1e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.990531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] The token cache is being invalidate because project b3680e10193b468a8a05ea312b5ef7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:10.990837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.990947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e6e51a9e8b496c90b10bcd7dd27a1e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.991766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.991960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e6e51a9e8b496c90b10bcd7dd27a1e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:10.994931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1130/2248] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:10 2022] DELETE /identity/v3/projects/b3680e10193b468a8a05ea312b5ef7d0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:10.999850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:11.002840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:11.015028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e6e51a9e8b496c90b10bcd7dd27a1e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.015028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e6e51a9e8b496c90b10bcd7dd27a1e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.045980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1119/2249] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:10 2022] DELETE /identity/v3/users/19e6e51a9e8b496c90b10bcd7dd27a1e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:11.095284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57cdd4-6323-4327-a5fd-4cd885c03013 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:11.187720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:11.188679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:11.189021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:11.189361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] PATH_INFO: `/v3/users/fb8128a3a8ad4ef6b9435eedf9fae32b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:11.190698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8128a3a8ad4ef6b9435eedf9fae32b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:11.192765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:11.264545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8128a3a8ad4ef6b9435eedf9fae32b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.275565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8128a3a8ad4ef6b9435eedf9fae32b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.276679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8128a3a8ad4ef6b9435eedf9fae32b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.290806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8128a3a8ad4ef6b9435eedf9fae32b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.291739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8128a3a8ad4ef6b9435eedf9fae32b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.311721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1131/2250] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:10 2022] DELETE /identity/v3/users/fb8128a3a8ad4ef6b9435eedf9fae32b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:11.529798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:11.531790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:11.575717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b5ad-1089-4798-9737-a410fbd43f80 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:11.675081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:11.676101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:11.676446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:11.676952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] PATH_INFO: `/v3/projects/daeee2b2288f4e0882449992b19f4812` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:11.678365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daeee2b2288f4e0882449992b19f4812)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:11.681072 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:11.743028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daeee2b2288f4e0882449992b19f4812', 'request_id': 'req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.753508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daeee2b2288f4e0882449992b19f4812', 'request_id': 'req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.762890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daeee2b2288f4e0882449992b19f4812', 'request_id': 'req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.775478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] The token cache is being invalidate because project daeee2b2288f4e0882449992b19f4812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:11.775802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.776428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c7d09779-fec4-42a3-9c5a-fbf994e14ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.778764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1120/2251] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:11 2022] DELETE /identity/v3/projects/daeee2b2288f4e0882449992b19f4812 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:46:11.782796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:11.784906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:11.798952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0e999-6dff-4ada-8af2-64ccd726803e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:11.894862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:11.895747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:11.896034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:11.896361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] PATH_INFO: `/v3/users/e9bf3d00fbab4e3581a0b08cd30337ce` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:11.897577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bf3d00fbab4e3581a0b08cd30337ce)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:11.899627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:11.970883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bf3d00fbab4e3581a0b08cd30337ce'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.983406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bf3d00fbab4e3581a0b08cd30337ce'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:11.991917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bf3d00fbab4e3581a0b08cd30337ce'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.009313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bf3d00fbab4e3581a0b08cd30337ce'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.010242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bf3d00fbab4e3581a0b08cd30337ce'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.028184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1132/2252] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:11 2022] DELETE /identity/v3/users/e9bf3d00fbab4e3581a0b08cd30337ce => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:12.285439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.285909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.286419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.319941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] MFA Rules not processed for user `47030b2f71c64e8884d1946f4ed2afdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:12.322891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:12.399364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:12.401479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:12.489728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1121/2253] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:12.502375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:12.504667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:12.557762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36517585-bad0-4339-bf8c-62ea0f334ca5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:12.564068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:12.565001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.565290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.565747 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] PATH_INFO: `/v3/projects/f799453ce0dc49728a4489367a9b6e94` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.567373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f799453ce0dc49728a4489367a9b6e94)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:12.569326 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:12.608788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23236a9f-35f7-4d6c-8e08-7d172a4b4803 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:12.613167 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:12.613994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.614383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.614757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.627804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:12.629628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:12.641732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1122/2254] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:12.645020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:12.646308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:12.649589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f799453ce0dc49728a4489367a9b6e94', 'request_id': 'req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.660956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f799453ce0dc49728a4489367a9b6e94', 'request_id': 'req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.665171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb3764-5d67-4c2e-b4e7-82cf84742660 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:12.670124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f799453ce0dc49728a4489367a9b6e94', 'request_id': 'req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.682636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] The token cache is being invalidate because project f799453ce0dc49728a4489367a9b6e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:12.682945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.683784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-d16ce86c-4992-4a3a-b4ba-8f4b68ddb552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.685961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1133/2255] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:12 2022] DELETE /identity/v3/projects/f799453ce0dc49728a4489367a9b6e94 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:46:12.693574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87ad90-b933-4384-aad5-1936bcfc778d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.693947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87ad90-b933-4384-aad5-1936bcfc778d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.694231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87ad90-b933-4384-aad5-1936bcfc778d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.719184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-bc87ad90-b933-4384-aad5-1936bcfc778d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:12.720823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-bc87ad90-b933-4384-aad5-1936bcfc778d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:12.743434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:12.744305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.744596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.745015 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] PATH_INFO: `/v3/projects/8fd1541c62b04837a629f3b60201fcfa` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.747564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd1541c62b04837a629f3b60201fcfa)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:12.749506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:12.797040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1134/2256] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:12.806085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5547-8758-46b3-b363-68644d911128 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.806445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5547-8758-46b3-b363-68644d911128 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.806787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5547-8758-46b3-b363-68644d911128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.807541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd1541c62b04837a629f3b60201fcfa', 'request_id': 'req-b43d32ea-05c1-4ea4-8219-2d0bdf976105'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.819993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd1541c62b04837a629f3b60201fcfa', 'request_id': 'req-b43d32ea-05c1-4ea4-8219-2d0bdf976105'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.832563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-cc4b5547-8758-46b3-b363-68644d911128 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:12.833989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-cc4b5547-8758-46b3-b363-68644d911128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:12.834834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd1541c62b04837a629f3b60201fcfa', 'request_id': 'req-b43d32ea-05c1-4ea4-8219-2d0bdf976105'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.848845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] The token cache is being invalidate because project 8fd1541c62b04837a629f3b60201fcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:12.849192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.850184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b43d32ea-05c1-4ea4-8219-2d0bdf976105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:12.851916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1123/2257] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:12 2022] DELETE /identity/v3/projects/8fd1541c62b04837a629f3b60201fcfa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:12.858499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04973cd5-1f49-4fcc-b862-1faa1d25d9c9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.858795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04973cd5-1f49-4fcc-b862-1faa1d25d9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.859312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04973cd5-1f49-4fcc-b862-1faa1d25d9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.886100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-04973cd5-1f49-4fcc-b862-1faa1d25d9c9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:12.888576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-04973cd5-1f49-4fcc-b862-1faa1d25d9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:12.915466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1135/2258] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:12.919531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5547-8758-46b3-b363-68644d911128 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:12.931719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5547-8758-46b3-b363-68644d911128 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:12.943397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:12.944308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.944942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.945339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:12.946393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:46:12.954678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:12.957729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:12.976194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1136/2259] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:46:12.981085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:12.986366 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1124/2260] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:12.995685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1c0d-9d8b-46c9-b093-f9d9b2e9188d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:12.996729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1c0d-9d8b-46c9-b093-f9d9b2e9188d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:12.997201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1c0d-9d8b-46c9-b093-f9d9b2e9188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.002590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90d09-7512-434a-abfa-72c98d415155 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.007847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.008814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.009278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.009743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.010641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.013889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.026178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-50fb1c0d-9d8b-46c9-b093-f9d9b2e9188d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:13.028270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-50fb1c0d-9d8b-46c9-b093-f9d9b2e9188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.038535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1125/2261] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:13.042770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb1c0d-9d8b-46c9-b093-f9d9b2e9188d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.063445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1137/2262] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:12 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:13.067503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.068277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb1c0d-9d8b-46c9-b093-f9d9b2e9188d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.167661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.168878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.169159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.169426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.170183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:46:13.170490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.172095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.179489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb603-f80d-4415-90ab-fa5dff6af837 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.185464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.186311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.186702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.187082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.190563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1126/2263] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:46:13.190711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.190711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.195006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.196817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.213449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153e72-4a87-4a64-baea-8ad47055b645 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.214857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1138/2264] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:13 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:13.218301 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.218433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.219250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.219604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.219950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] PATH_INFO: `/v3/users/a29a589c1141436ba4c052ceff48a99f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.221367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29a589c1141436ba4c052ceff48a99f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.223473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.228576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07013fe7-96b6-4f19-b666-dbebdd526ddb admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.234047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.234700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.234994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.235270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.235958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.237900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.265325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1139/2265] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:13 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:13.269525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.286669 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29a589c1141436ba4c052ceff48a99f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:13.294034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29a589c1141436ba4c052ceff48a99f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:13.294717 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29a589c1141436ba4c052ceff48a99f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:13.306237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29a589c1141436ba4c052ceff48a99f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:13.306905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29a589c1141436ba4c052ceff48a99f'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:13.320164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1127/2266] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:13 2022] DELETE /identity/v3/users/a29a589c1141436ba4c052ceff48a99f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:13.321308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.323036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.331871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66cfd9-7775-4d99-81b8-939f4e9e3b7c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.389551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548cfde-e1db-4039-9b10-e4f82adb301d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.390267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548cfde-e1db-4039-9b10-e4f82adb301d admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.390552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548cfde-e1db-4039-9b10-e4f82adb301d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.390827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548cfde-e1db-4039-9b10-e4f82adb301d admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.391553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548cfde-e1db-4039-9b10-e4f82adb301d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.391664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4b21-0448-4b9f-a860-265f4749ad7a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.393228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548cfde-e1db-4039-9b10-e4f82adb301d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.396188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.396875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.397158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.397431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.398157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.400061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.403846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1140/2267] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:13.405073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65226-36f8-41ef-b1d6-19d4c47866cd None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.405364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65226-36f8-41ef-b1d6-19d4c47866cd None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.405643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65226-36f8-41ef-b1d6-19d4c47866cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.421835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1128/2268] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:13 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:13.425945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.426202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-cfd65226-36f8-41ef-b1d6-19d4c47866cd None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:13.427391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-cfd65226-36f8-41ef-b1d6-19d4c47866cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.427488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.435061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1141/2269] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:13.435061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65226-36f8-41ef-b1d6-19d4c47866cd None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.439322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908af55-fecd-4790-8d69-291c07b7bfaa admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.445281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.445969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.446129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65226-36f8-41ef-b1d6-19d4c47866cd None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.446255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.446523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.447376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.448990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.458742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.459488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.462821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.462821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.462821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.463426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1129/2270] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:13.463426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.463594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.467625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.477059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1142/2271] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:13.477899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.488171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51663f9f-bcd8-409e-be52-6caf47481e43 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.493043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.494011 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.494352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.494769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] PATH_INFO: `/v3/projects/5525d1f5653948fc92558484ff330f8c/users/7181a86b5f5b4c73a41338f499ea4949/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.510825 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5525d1f5653948fc92558484ff330f8c, user_id=7181a86b5f5b4c73a41338f499ea4949, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.513928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.528577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1143/2272] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:13 2022] PUT /identity/v3/projects/5525d1f5653948fc92558484ff330f8c/users/7181a86b5f5b4c73a41338f499ea4949/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:13.530190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.545103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b85c-4e21-4ee6-b40e-a92f362806d8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.596164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.596739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.597024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.597303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.611592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404b2ba-68b1-451e-a707-c2763193df9e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.616533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76183d2d-88a0-41e2-adef-4594b843f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.617581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76183d2d-88a0-41e2-adef-4594b843f553 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.617902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76183d2d-88a0-41e2-adef-4594b843f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.618181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76183d2d-88a0-41e2-adef-4594b843f553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.619031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76183d2d-88a0-41e2-adef-4594b843f553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.621749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76183d2d-88a0-41e2-adef-4594b843f553 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.639827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1144/2273] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:13.641224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.641517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.641967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.673032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] MFA Rules not processed for user `7181a86b5f5b4c73a41338f499ea4949`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:13.674198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.674470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.675855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.686658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1130/2274] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:13.687404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.697352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44520a6f-80f9-4d96-b686-3b00a97bbc19 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.706033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbacb1-8359-4226-a968-1311e87f4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.707188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbacb1-8359-4226-a968-1311e87f4884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.707537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbacb1-8359-4226-a968-1311e87f4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.707816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbacb1-8359-4226-a968-1311e87f4884 admin admin] PATH_INFO: `/v3/projects/c9a910c072624637aef7a055ceebf3eb/users/a6efc7eb53f94779bd16e4f58edf2236/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.727863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbacb1-8359-4226-a968-1311e87f4884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a910c072624637aef7a055ceebf3eb, user_id=a6efc7eb53f94779bd16e4f58edf2236, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.731794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbacb1-8359-4226-a968-1311e87f4884 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.751082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1131/2275] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:13 2022] PUT /identity/v3/projects/c9a910c072624637aef7a055ceebf3eb/users/a6efc7eb53f94779bd16e4f58edf2236/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:13.764228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9d992-48f3-458b-9980-ff1faaa0454f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.764696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9d992-48f3-458b-9980-ff1faaa0454f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.765152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9d992-48f3-458b-9980-ff1faaa0454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.796705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1145/2276] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:13.800192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ccc9d992-48f3-458b-9980-ff1faaa0454f None None] MFA Rules not processed for user `a6efc7eb53f94779bd16e4f58edf2236`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:13.801409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ccc9d992-48f3-458b-9980-ff1faaa0454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.805242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.806823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:13.879661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1132/2277] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:13.884083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9d992-48f3-458b-9980-ff1faaa0454f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.898496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff0f31-9d2c-49fc-ab9b-ff65f8cfbe3c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.952178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9d992-48f3-458b-9980-ff1faaa0454f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:13.952957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.953616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.953941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.954360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.956519 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:13.957248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:13.957625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:13.958000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:13.958775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:13.960773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:13.996588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1133/2278] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:13 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:46:13.997390 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:13.999109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.017760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.019206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.029305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1146/2279] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:14.030516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.044010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0362-1d0c-47ea-bc24-ec6f6b776ab3 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.072207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fe6ac-8f7b-4bfd-9ac2-d3fc837cf132 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.078024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.078886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.079233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.079424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] PATH_INFO: `/v3/projects/27c66c53d7c443749ee12d9c6478a8e3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.090325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c66c53d7c443749ee12d9c6478a8e3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.092375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.113305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.114010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.114297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.114575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.115272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.117216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.138964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1147/2280] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:14.139804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.141983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c66c53d7c443749ee12d9c6478a8e3', 'request_id': 'req-57db2208-6a07-461c-9ac0-ede004fa4e78'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.149475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89bbf-83a3-4c3a-ace0-b74cac89133a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.149622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c66c53d7c443749ee12d9c6478a8e3', 'request_id': 'req-57db2208-6a07-461c-9ac0-ede004fa4e78'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.157008 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c66c53d7c443749ee12d9c6478a8e3', 'request_id': 'req-57db2208-6a07-461c-9ac0-ede004fa4e78'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.167727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] The token cache is being invalidate because project 27c66c53d7c443749ee12d9c6478a8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:14.168592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.169302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-57db2208-6a07-461c-9ac0-ede004fa4e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.171196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1134/2281] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:13 2022] DELETE /identity/v3/projects/27c66c53d7c443749ee12d9c6478a8e3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:14.172538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.172830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.173117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.191193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] MFA Rules not processed for user `47030b2f71c64e8884d1946f4ed2afdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:14.192406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.216878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.217791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.218078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.218354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] PATH_INFO: `/v3/users/7181a86b5f5b4c73a41338f499ea4949` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.219563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7181a86b5f5b4c73a41338f499ea4949)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.221499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.251133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1135/2282] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:14.252073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.253370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.275035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d31ac-514a-4216-a4c7-fe52e15bdf79 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.283307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d87db-cebe-4422-b631-ffb4a94517ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.283927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d87db-cebe-4422-b631-ffb4a94517ce admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.284239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d87db-cebe-4422-b631-ffb4a94517ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.284517 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d87db-cebe-4422-b631-ffb4a94517ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.285252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d87db-cebe-4422-b631-ffb4a94517ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.286888 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d87db-cebe-4422-b631-ffb4a94517ce admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.287277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7181a86b5f5b4c73a41338f499ea4949'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.298026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7181a86b5f5b4c73a41338f499ea4949'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.300443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1136/2283] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:14.300577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7181a86b5f5b4c73a41338f499ea4949'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.301624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9618a-2e98-428d-ad42-cb5b75962ce0 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.301624 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9618a-2e98-428d-ad42-cb5b75962ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.302084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9618a-2e98-428d-ad42-cb5b75962ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.320088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7181a86b5f5b4c73a41338f499ea4949'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.320885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7181a86b5f5b4c73a41338f499ea4949'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:14.327654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4ef9618a-2e98-428d-ad42-cb5b75962ce0 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:14.329502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4ef9618a-2e98-428d-ad42-cb5b75962ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.337566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1148/2284] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:14 2022] DELETE /identity/v3/users/7181a86b5f5b4c73a41338f499ea4949 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:14.338396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.340197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.346870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1137/2285] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:14.348962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec6482-b46d-45b4-ae3a-555e46b20ade None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.349398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec6482-b46d-45b4-ae3a-555e46b20ade None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.349683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec6482-b46d-45b4-ae3a-555e46b20ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.380201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e4ec6482-b46d-45b4-ae3a-555e46b20ade None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:14.381455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e4ec6482-b46d-45b4-ae3a-555e46b20ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.419698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeb916-eb51-4c27-8cf6-72af74052bf8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.425638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271592d-2a3e-444b-8330-9f4c4c37c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.426925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271592d-2a3e-444b-8330-9f4c4c37c033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.427387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271592d-2a3e-444b-8330-9f4c4c37c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.427866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271592d-2a3e-444b-8330-9f4c4c37c033 admin admin] PATH_INFO: `/v3/projects/93b8b7b0a4014501b7231971ec96bf5e/users/9bd7a2e7835e4316b36966a51f1341fc/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.455670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271592d-2a3e-444b-8330-9f4c4c37c033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b8b7b0a4014501b7231971ec96bf5e, user_id=9bd7a2e7835e4316b36966a51f1341fc, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.458935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271592d-2a3e-444b-8330-9f4c4c37c033 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.479103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1149/2286] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:14 2022] PUT /identity/v3/projects/93b8b7b0a4014501b7231971ec96bf5e/users/9bd7a2e7835e4316b36966a51f1341fc/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:14.480240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.480564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.480844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.501084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1138/2287] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:14.501303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:14.502149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec6482-b46d-45b4-ae3a-555e46b20ade None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.502719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.515187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec6482-b46d-45b4-ae3a-555e46b20ade None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.572238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1150/2288] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:14.573383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.574707 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.583718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.584397 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.584742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.585028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.585816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.587726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.597966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1139/2289] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:14.601921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.612865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc30856-9c86-4a21-8752-1833ebc40017 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.617534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.618222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.618507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.618785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.619538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:46:14.619851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.622069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.642048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1140/2290] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:46:14.643148 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.644346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe077-1dff-4d5c-bc70-e5fee3b75d83 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.647971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.648618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.648928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.649208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.654007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5533-6c19-4c31-a7fd-9799635f7104 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.661396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.663618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.667478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60107-42b8-4ed7-ac4d-e82e9aad435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.668788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60107-42b8-4ed7-ac4d-e82e9aad435c admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.669229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60107-42b8-4ed7-ac4d-e82e9aad435c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.669512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60107-42b8-4ed7-ac4d-e82e9aad435c admin admin] PATH_INFO: `/v3/projects/93b8b7b0a4014501b7231971ec96bf5e/users/9bd7a2e7835e4316b36966a51f1341fc/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.671954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60107-42b8-4ed7-ac4d-e82e9aad435c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b8b7b0a4014501b7231971ec96bf5e, user_id=9bd7a2e7835e4316b36966a51f1341fc, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.674440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1151/2291] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:14.674804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60107-42b8-4ed7-ac4d-e82e9aad435c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.675042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.684560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93d667-f81c-4c99-98a1-72ef2eefe3d0 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.691892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1141/2292] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:14 2022] PUT /identity/v3/projects/93b8b7b0a4014501b7231971ec96bf5e/users/9bd7a2e7835e4316b36966a51f1341fc/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:14.705534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.706276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.706796 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.745845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] MFA Rules not processed for user `9bd7a2e7835e4316b36966a51f1341fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:14.747623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.772974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.773782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.774137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.774486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.775258 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.778262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:14.816789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1152/2293] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:14.820936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.837364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1142/2294] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:14.849967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:14.851453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:14.943236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84bde8-b773-4de7-b2ee-4148716a18db None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.956310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e90f2-22b2-4e0f-8f24-59adad616ff9 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:14.981203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:14.981931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:14.982220 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:14.982694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:14.983184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:14.987733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.012379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:15.013044 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.013875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.014168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.041253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1153/2295] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:14 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:46:15.045950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:15.065938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1f63-3a55-4be2-b7cc-3994ff38c353 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:15.078604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:15.083427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.083720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.084000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.084742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:15.086390 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.112885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1154/2296] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:15.116958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:15.174186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824eb7-9991-4d4a-a6af-7fc6fa73d0e2 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:15.180189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:15.180934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.181350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.181717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.182717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:15.183349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:15.184737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.184879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.197789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1143/2297] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:15.199143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:15.201753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:15.224103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4103-c13b-427d-85ad-cbfce8613883 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:15.228518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1155/2298] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:46:15.229107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:15.230026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.230447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.230614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] PATH_INFO: `/v3/projects/5525d1f5653948fc92558484ff330f8c` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.232866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5525d1f5653948fc92558484ff330f8c)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:15.233373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:15.235132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.279886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b00ba6-76d0-49d4-9938-1a799990e199 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:15.293325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f88fc-8702-41b6-aea8-053b0bf5234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:15.294333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f88fc-8702-41b6-aea8-053b0bf5234b admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.294622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f88fc-8702-41b6-aea8-053b0bf5234b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.294996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f88fc-8702-41b6-aea8-053b0bf5234b admin admin] PATH_INFO: `/v3/projects/95636bf5a2284bc697044d2b3b46828a/users/59c0922d8e2f4389a3aa4b6daa9d3d37/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.318061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5525d1f5653948fc92558484ff330f8c', 'request_id': 'req-2b87ab87-7cd0-41e6-871b-db0d6587a774'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:15.325060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f88fc-8702-41b6-aea8-053b0bf5234b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95636bf5a2284bc697044d2b3b46828a, user_id=59c0922d8e2f4389a3aa4b6daa9d3d37, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:15.329359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f88fc-8702-41b6-aea8-053b0bf5234b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.334700 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5525d1f5653948fc92558484ff330f8c', 'request_id': 'req-2b87ab87-7cd0-41e6-871b-db0d6587a774'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:15.344585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5525d1f5653948fc92558484ff330f8c', 'request_id': 'req-2b87ab87-7cd0-41e6-871b-db0d6587a774'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:15.349516 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1156/2299] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:15 2022] PUT /identity/v3/projects/95636bf5a2284bc697044d2b3b46828a/users/59c0922d8e2f4389a3aa4b6daa9d3d37/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:15.359634 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.360159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.360625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.371037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] The token cache is being invalidate because project 5525d1f5653948fc92558484ff330f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:15.371512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:15.372860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:15.375233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1144/2300] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:15 2022] DELETE /identity/v3/projects/5525d1f5653948fc92558484ff330f8c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:15.396961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:15.398450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:15.414251 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:15.416128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:15.535617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1157/2301] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:15.548777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:15.548963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87ab87-7cd0-41e6-871b-db0d6587a774 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:15.550618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:15.632999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13cdae-3a05-4086-ab82-e3d0856189c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:15.633663 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cdae-3a05-4086-ab82-e3d0856189c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.633979 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cdae-3a05-4086-ab82-e3d0856189c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.634259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cdae-3a05-4086-ab82-e3d0856189c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.636054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ec13cdae-3a05-4086-ab82-e3d0856189c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:15.645305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428309e-b3a6-4768-990a-f8e8bdf1dac4 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:15.649869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:15.650852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:15.651359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:15.651839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:15.670033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:15.671740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.684946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1158/2302] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:15.721411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13cdae-3a05-4086-ab82-e3d0856189c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:15.722993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13cdae-3a05-4086-ab82-e3d0856189c3 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:15.734742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1145/2303] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:46:21.406243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:21.407738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:21.420968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0546-5ad7-4b43-b7e0-6261ddb9f4a4 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:21.425544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:21.426547 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:21.426836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:21.427114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] PATH_INFO: `/v3/users/a6efc7eb53f94779bd16e4f58edf2236` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:21.428303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6efc7eb53f94779bd16e4f58edf2236)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:21.430255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:21.488488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6efc7eb53f94779bd16e4f58edf2236'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:21.498280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6efc7eb53f94779bd16e4f58edf2236'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:21.499012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6efc7eb53f94779bd16e4f58edf2236'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:21.520186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6efc7eb53f94779bd16e4f58edf2236'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:21.521096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6efc7eb53f94779bd16e4f58edf2236'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:21.535945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1159/2304] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:21 2022] DELETE /identity/v3/users/a6efc7eb53f94779bd16e4f58edf2236 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:21.541996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98848e-4867-4280-807c-05443e9517d8 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:21.543368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98848e-4867-4280-807c-05443e9517d8 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:21.543654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98848e-4867-4280-807c-05443e9517d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:21.569364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6e98848e-4867-4280-807c-05443e9517d8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:21.570580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6e98848e-4867-4280-807c-05443e9517d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:21.663109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1146/2305] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:21.671980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:21.674362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:21.784346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0ef2c-4b74-4a5b-904e-84207172343c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:21.790262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:21.791205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:21.791703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:21.792257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:21.804061 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:21.805868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:21.816858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1160/2306] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:21.883881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91386e48-2933-4798-9d52-adb277c13fdf None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:21.884922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91386e48-2933-4798-9d52-adb277c13fdf None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:21.885405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91386e48-2933-4798-9d52-adb277c13fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:21.963619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-91386e48-2933-4798-9d52-adb277c13fdf None None] MFA Rules not processed for user `59c0922d8e2f4389a3aa4b6daa9d3d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:21.965302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-91386e48-2933-4798-9d52-adb277c13fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:22.081670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1147/2307] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:22.083373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.085008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:22.099484 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e007-fd3c-4d96-bb55-4d6be88717ad service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.104537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.105776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.106064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.106342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.107581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.109508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.143008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1161/2308] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:22 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:22.146970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91386e48-2933-4798-9d52-adb277c13fdf None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.158344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91386e48-2933-4798-9d52-adb277c13fdf None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.243957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.245543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:22.262762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.263453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.263734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.264007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.264706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.266802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.316435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1148/2309] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:22 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:22.318038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.337435 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad21d7-3750-478b-8894-37925f0e7df5 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.358741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f41460-56ab-415d-99d5-019a69fcf31b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.359924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.360607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.360892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.361171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.361934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.363548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.363974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.364843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.365121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.365395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] PATH_INFO: `/v3/projects/c9a910c072624637aef7a055ceebf3eb` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.367871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a910c072624637aef7a055ceebf3eb)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.371694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.378415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1149/2310] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:22.383020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.394011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74d96a-f4d0-493d-9e3a-108fb2697e68 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.399098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.399996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.400281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.400563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] PATH_INFO: `/v3/projects/18db6e6c7e4842cf83d8cf1a54e294d2/users/778a13a6cbca4628924594f5c5c94af7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.416895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18db6e6c7e4842cf83d8cf1a54e294d2, user_id=778a13a6cbca4628924594f5c5c94af7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.420134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.444894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1150/2311] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:22 2022] PUT /identity/v3/projects/18db6e6c7e4842cf83d8cf1a54e294d2/users/778a13a6cbca4628924594f5c5c94af7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:22.445916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.471914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a910c072624637aef7a055ceebf3eb', 'request_id': 'req-4018605a-9047-4b86-92b4-2070b7095607'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.485745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a910c072624637aef7a055ceebf3eb', 'request_id': 'req-4018605a-9047-4b86-92b4-2070b7095607'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.497006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a910c072624637aef7a055ceebf3eb', 'request_id': 'req-4018605a-9047-4b86-92b4-2070b7095607'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.524163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] The token cache is being invalidate because project c9a910c072624637aef7a055ceebf3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:22.524660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.526090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.533323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1162/2312] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:22 2022] DELETE /identity/v3/projects/c9a910c072624637aef7a055ceebf3eb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:22.535811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.538810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:22.581275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3687-212a-4b5c-adb8-2f5d311de50d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.655093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.655906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.656460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.656842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.659989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.660327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.668496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018605a-9047-4b86-92b4-2070b7095607 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.676536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1151/2313] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:22.676706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.676706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.676706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.676706 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] PATH_INFO: `/v3/users/9bd7a2e7835e4316b36966a51f1341fc` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.677676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd7a2e7835e4316b36966a51f1341fc)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.678034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:22.680093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.681227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:22.702925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d758939-d15f-40bd-97da-fdd5aa3561a2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:22.710092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:22.711061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:22.711415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:22.711810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] PATH_INFO: `/v3/projects/18db6e6c7e4842cf83d8cf1a54e294d2/users/778a13a6cbca4628924594f5c5c94af7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:22.715312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18db6e6c7e4842cf83d8cf1a54e294d2, user_id=778a13a6cbca4628924594f5c5c94af7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:22.718738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:22.732690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1152/2314] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:22 2022] PUT /identity/v3/projects/18db6e6c7e4842cf83d8cf1a54e294d2/users/778a13a6cbca4628924594f5c5c94af7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:22.751710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd7a2e7835e4316b36966a51f1341fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.764622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd7a2e7835e4316b36966a51f1341fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.766108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd7a2e7835e4316b36966a51f1341fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.784148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd7a2e7835e4316b36966a51f1341fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.787177 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-849fb393-5248-4762-9214-7c140233c16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd7a2e7835e4316b36966a51f1341fc'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:22.840965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1163/2315] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:22 2022] DELETE /identity/v3/users/9bd7a2e7835e4316b36966a51f1341fc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:23.955052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:23.957123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:24.116228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4554211-229a-41f7-be04-9d78e9743aa6 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:24.195620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:24.197938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.199341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.199639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] PATH_INFO: `/v3/projects/93b8b7b0a4014501b7231971ec96bf5e` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.201100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b8b7b0a4014501b7231971ec96bf5e)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:24.203824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:24.276121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b8b7b0a4014501b7231971ec96bf5e', 'request_id': 'req-858575b7-0c26-4105-8efd-11b0b00ec4c3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:24.289318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b8b7b0a4014501b7231971ec96bf5e', 'request_id': 'req-858575b7-0c26-4105-8efd-11b0b00ec4c3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:24.301391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b8b7b0a4014501b7231971ec96bf5e', 'request_id': 'req-858575b7-0c26-4105-8efd-11b0b00ec4c3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:24.315050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] The token cache is being invalidate because project 93b8b7b0a4014501b7231971ec96bf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:24.316200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:24.316200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-858575b7-0c26-4105-8efd-11b0b00ec4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:24.318061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1153/2316] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:23 2022] DELETE /identity/v3/projects/93b8b7b0a4014501b7231971ec96bf5e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:46:24.322858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109daeb-5b33-4d87-a90b-2175463d5c25 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.324577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109daeb-5b33-4d87-a90b-2175463d5c25 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.325188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109daeb-5b33-4d87-a90b-2175463d5c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.348674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-f109daeb-5b33-4d87-a90b-2175463d5c25 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:24.350049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f109daeb-5b33-4d87-a90b-2175463d5c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:24.450056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1164/2317] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:24.457863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23f1db-ec19-43d8-bf19-520c07ae40f9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.458494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23f1db-ec19-43d8-bf19-520c07ae40f9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.459016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23f1db-ec19-43d8-bf19-520c07ae40f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.486035 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7d23f1db-ec19-43d8-bf19-520c07ae40f9 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:24.490157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7d23f1db-ec19-43d8-bf19-520c07ae40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:24.507638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1154/2318] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:24.512325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109daeb-5b33-4d87-a90b-2175463d5c25 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:24.526976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109daeb-5b33-4d87-a90b-2175463d5c25 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:24.534598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:24.536264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.536783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.537282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.539019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:46:24.539590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:24.545361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:24.563025 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1165/2319] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:46:24.567380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23f1db-ec19-43d8-bf19-520c07ae40f9 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:24.580314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23f1db-ec19-43d8-bf19-520c07ae40f9 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:24.591816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:24.593309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.593895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.594369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.596012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:24.601790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:24.655261 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1155/2320] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:24 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:24.660118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:24.677231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c8779-09bc-40c3-9274-e5afc99f06de admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:24.776618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:24.778151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.778433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.778702 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.779411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:24.781363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:24.817986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1166/2321] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:24 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:24.819676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:24.848829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939075e-af4c-4389-aea4-2ab98220d799 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:24.854021 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:24.855908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.855908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.863752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.864704 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:24.867639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:24.891072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:24.891512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1156/2322] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:24.901072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc819e-3e59-48cd-b390-88845fcb93c3 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:24.916492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70f12e-63e9-4c0c-bdc1-5340bd10aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:24.917413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f12e-63e9-4c0c-bdc1-5340bd10aafd admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.918374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f12e-63e9-4c0c-bdc1-5340bd10aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.918820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f12e-63e9-4c0c-bdc1-5340bd10aafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.919824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70f12e-63e9-4c0c-bdc1-5340bd10aafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:24.921603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70f12e-63e9-4c0c-bdc1-5340bd10aafd admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:24.938189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:24.945227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1167/2323] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:24.950840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b0c3-6435-452a-916c-baee8ec47dc7 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:24.957905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:24.959733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:24.960353 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:24.961407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] PATH_INFO: `/v3/projects/c64a2cf8a2684547a4d198fc7435bac9/users/572212d93e10430497df344fa269ed13/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:24.979791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64a2cf8a2684547a4d198fc7435bac9, user_id=572212d93e10430497df344fa269ed13, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:24.983963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:25.023254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adf195-a5bf-40b1-ab98-4c3889663754 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:25.023682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adf195-a5bf-40b1-ab98-4c3889663754 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:25.024028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adf195-a5bf-40b1-ab98-4c3889663754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:25.025963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1157/2324] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:24 2022] PUT /identity/v3/projects/c64a2cf8a2684547a4d198fc7435bac9/users/572212d93e10430497df344fa269ed13/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:25.065313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d0adf195-a5bf-40b1-ab98-4c3889663754 None None] MFA Rules not processed for user `572212d93e10430497df344fa269ed13`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:25.066801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d0adf195-a5bf-40b1-ab98-4c3889663754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:25.188614 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1168/2325] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:25.204330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:25.206790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:25.311041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85e29b-f325-49b2-a812-854b5b840ddb admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:25.315753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7291e3af37548efafd5e4654569677b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:25.316434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:25.316713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:25.317050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:25.349690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:25.351781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:25.376881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1158/2326] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:29.944277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae134e5-abd7-4445-b2a0-52ca8299065b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:29.945135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae134e5-abd7-4445-b2a0-52ca8299065b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:29.945592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae134e5-abd7-4445-b2a0-52ca8299065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:29.985849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2ae134e5-abd7-4445-b2a0-52ca8299065b None None] MFA Rules not processed for user `778a13a6cbca4628924594f5c5c94af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:29.987378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2ae134e5-abd7-4445-b2a0-52ca8299065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:30.071524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1169/2327] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:30.083716 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:30.093115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575726aa-907e-4236-89dd-c4736d29e1ab service glance] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:30.097248 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7291e3af37548efafd5e4654569677b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:30.098228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:30.098486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:30.098813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:30.100935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:30.162528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:30.163997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:30.173941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1159/2328] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:30.296960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf384e-d00d-4b71-9fc8-8f1230c8644a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:30.297254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf384e-d00d-4b71-9fc8-8f1230c8644a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:30.297665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf384e-d00d-4b71-9fc8-8f1230c8644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:30.319737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-06bf384e-d00d-4b71-9fc8-8f1230c8644a None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:30.321065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-06bf384e-d00d-4b71-9fc8-8f1230c8644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:30.381877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1170/2329] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:46:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:30.395531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:30.396986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:30.471893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0587-0bde-449d-a2b6-cbe6d6d0cf5e service glance] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:30.477819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90dfa6-b4a1-4d93-b7eb-166817e93288 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:30.478343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90dfa6-b4a1-4d93-b7eb-166817e93288 service swift] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:30.478628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90dfa6-b4a1-4d93-b7eb-166817e93288 service swift] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:30.478919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90dfa6-b4a1-4d93-b7eb-166817e93288 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:30.501805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90dfa6-b4a1-4d93-b7eb-166817e93288 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:30.503651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90dfa6-b4a1-4d93-b7eb-166817e93288 service swift] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:30.516367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1160/2330] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:46:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:46:40.425491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:40.426102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:40.426102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:40.443146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] MFA Rules not processed for user `59c0922d8e2f4389a3aa4b6daa9d3d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:40.444350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:40.457223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1171/2331] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:41.293055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7c479-a0e1-4a9c-89d3-db4be434664b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:41.293616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7c479-a0e1-4a9c-89d3-db4be434664b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:41.293616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7c479-a0e1-4a9c-89d3-db4be434664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:41.312606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6ed7c479-a0e1-4a9c-89d3-db4be434664b None None] MFA Rules not processed for user `47030b2f71c64e8884d1946f4ed2afdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:41.313965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6ed7c479-a0e1-4a9c-89d3-db4be434664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:41.374322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1161/2332] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:42.011352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:42.013027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:42.092380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fe33e-0c71-4593-b0db-6e58ba53d4b9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:42.097686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:42.098698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:42.099148 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:42.099577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] PATH_INFO: `/v3/users/6397a996090d4ca3800c2c7be079203d` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:42.101617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6397a996090d4ca3800c2c7be079203d)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:42.103810 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:42.183591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6397a996090d4ca3800c2c7be079203d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:42.193080 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6397a996090d4ca3800c2c7be079203d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:42.193952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6397a996090d4ca3800c2c7be079203d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:42.208641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6397a996090d4ca3800c2c7be079203d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:42.209519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6397a996090d4ca3800c2c7be079203d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:42.228395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1172/2333] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:42 2022] DELETE /identity/v3/users/6397a996090d4ca3800c2c7be079203d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:42.233013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951714-5486-449c-bc8e-0844bc81b472 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:42.233439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951714-5486-449c-bc8e-0844bc81b472 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:42.234016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951714-5486-449c-bc8e-0844bc81b472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:42.267884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-61951714-5486-449c-bc8e-0844bc81b472 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:42.270022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-61951714-5486-449c-bc8e-0844bc81b472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:42.341320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1162/2334] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:42.353919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:42.356421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:42.429465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ce42-c027-4476-8386-ba42e3356e91 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:42.440330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:42.441468 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:42.442066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:42.442565 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:42.454863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:42.456677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:42.467308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1173/2335] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:42.552579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:42.553648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:42.554106 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:42.586069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:42.587472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:42.678339 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1163/2336] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:46:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:42.682627 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:42.684165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:42.795624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7df77-fc93-41d5-9e2f-8a7bc99daa3a service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:42.802745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fdd6a-0896-45ca-821d-feeda2675cb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:42.803408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdd6a-0896-45ca-821d-feeda2675cb6 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:42.803697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdd6a-0896-45ca-821d-feeda2675cb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:42.803972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fdd6a-0896-45ca-821d-feeda2675cb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:42.813920 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fdd6a-0896-45ca-821d-feeda2675cb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:42.816334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fdd6a-0896-45ca-821d-feeda2675cb6 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:42.825619 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1174/2337] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:46:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:46:43.056533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:43.058850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:43.077869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa37c-c9f5-40df-bf2f-836016d8f998 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:43.082610 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:43.083952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.084234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.084792 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] PATH_INFO: `/v3/projects/c794de542790479fb8c2b4c9448aed59` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.086593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c794de542790479fb8c2b4c9448aed59)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:43.089675 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:43.165569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c794de542790479fb8c2b4c9448aed59', 'request_id': 'req-be74a9b4-28c4-4e41-831d-997ddba7e0c8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:43.180769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c794de542790479fb8c2b4c9448aed59', 'request_id': 'req-be74a9b4-28c4-4e41-831d-997ddba7e0c8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:43.202183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c794de542790479fb8c2b4c9448aed59', 'request_id': 'req-be74a9b4-28c4-4e41-831d-997ddba7e0c8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:43.232358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] The token cache is being invalidate because project c794de542790479fb8c2b4c9448aed59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:43.233010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:43.235412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-be74a9b4-28c4-4e41-831d-997ddba7e0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:43.238997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1164/2338] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:43 2022] DELETE /identity/v3/projects/c794de542790479fb8c2b4c9448aed59 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:43.243535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c4d9-13ea-47ed-9b57-2bc4a5d920d4 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.244131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c4d9-13ea-47ed-9b57-2bc4a5d920d4 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.244131 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c4d9-13ea-47ed-9b57-2bc4a5d920d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.285324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ea63c4d9-13ea-47ed-9b57-2bc4a5d920d4 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:43.286811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ea63c4d9-13ea-47ed-9b57-2bc4a5d920d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:43.423712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1175/2339] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:43.424989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648407c-797b-45c1-9463-979f989cb69e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.425452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648407c-797b-45c1-9463-979f989cb69e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.425452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648407c-797b-45c1-9463-979f989cb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.463428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-1648407c-797b-45c1-9463-979f989cb69e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:43.465333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1648407c-797b-45c1-9463-979f989cb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:43.485251 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1165/2340] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:43.485644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63c4d9-13ea-47ed-9b57-2bc4a5d920d4 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:43.495740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63c4d9-13ea-47ed-9b57-2bc4a5d920d4 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:43.516957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:43.517645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.517956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.518234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.518972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:46:43.519450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:43.521216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:43.550807 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1176/2341] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:46:43.555535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648407c-797b-45c1-9463-979f989cb69e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:43.578276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648407c-797b-45c1-9463-979f989cb69e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:43.583762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:43.584431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.584710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.584980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.585671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:43.587619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:43.627656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1166/2342] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:43 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:43.632409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:43.644481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3fc68-ab09-408d-a8b1-0fa4fde7ae56 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:43.710242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:43.710858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.711144 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.711422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.712117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:43.714670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:43.739495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1177/2343] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:43 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:43.743507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:43.755883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea69b4-a6bc-4811-8341-7f42ec800b7f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:43.763483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:43.764156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.764438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.764711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.765441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:43.767100 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:43.781215 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1167/2344] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:43.786402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:43.804705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473e717-7f31-4a28-888f-70ef9268830a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:43.821143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e99f3d-383c-49fa-978a-c27a5c91e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:43.821872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e99f3d-383c-49fa-978a-c27a5c91e68a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.822210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e99f3d-383c-49fa-978a-c27a5c91e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.822447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e99f3d-383c-49fa-978a-c27a5c91e68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.823203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e99f3d-383c-49fa-978a-c27a5c91e68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:43.824949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e99f3d-383c-49fa-978a-c27a5c91e68a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:43.838451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1178/2345] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:46:43.842606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:43.853763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb2ba-4e92-491b-8cd2-f9fa901aee47 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:43.859733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:43.860652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.860936 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.861980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] PATH_INFO: `/v3/projects/68baf63becdb45609e62f9a4e861dcae/users/26470c593c834210ac502d4fa2e7907d/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.884905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68baf63becdb45609e62f9a4e861dcae, user_id=26470c593c834210ac502d4fa2e7907d, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:43.890873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:43.906919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1168/2346] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:43 2022] PUT /identity/v3/projects/68baf63becdb45609e62f9a4e861dcae/users/26470c593c834210ac502d4fa2e7907d/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:43.919589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:43.919883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:43.920188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:43.955125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] MFA Rules not processed for user `26470c593c834210ac502d4fa2e7907d`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:43.956553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:44.039803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1179/2347] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:44.048042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:44.049865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:44.118188 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f87a1b-bc9d-4261-882d-be38d46f3b8e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:44.125727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e3585-9250-4898-811b-144a571e0415 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7291e3af37548efafd5e4654569677b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:44.126524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3585-9250-4898-811b-144a571e0415 service glance] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:44.126806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3585-9250-4898-811b-144a571e0415 service glance] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:44.127083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3585-9250-4898-811b-144a571e0415 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:44.136219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e3585-9250-4898-811b-144a571e0415 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:44.137648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e3585-9250-4898-811b-144a571e0415 service glance] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:44.149640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1169/2348] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:46:48.901428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:48.903002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:48.975441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb00c-383a-47f2-a1b7-10c8e0d0fa57 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:48.979973 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:48.980852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:48.981134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:48.981411 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] PATH_INFO: `/v3/users/572212d93e10430497df344fa269ed13` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:48.982655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=572212d93e10430497df344fa269ed13)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:48.984994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:49.037548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572212d93e10430497df344fa269ed13'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.045514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572212d93e10430497df344fa269ed13'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.046223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572212d93e10430497df344fa269ed13'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.059471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572212d93e10430497df344fa269ed13'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.060151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572212d93e10430497df344fa269ed13'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.080229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1180/2349] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:46:48 2022] DELETE /identity/v3/users/572212d93e10430497df344fa269ed13 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:49.084775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:49.085305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:49.085405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:49.111970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:49.113195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:49.178470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1170/2350] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:46:49.188655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:49.190128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:49.269980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f1ab-ff7a-419d-beb1-d34e99324204 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:49.273988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe18378-69f6-4833-a26b-bd0f2d84f27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:49.274637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe18378-69f6-4833-a26b-bd0f2d84f27f service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:49.274921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe18378-69f6-4833-a26b-bd0f2d84f27f service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:49.275198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe18378-69f6-4833-a26b-bd0f2d84f27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:49.284366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe18378-69f6-4833-a26b-bd0f2d84f27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:49.285828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe18378-69f6-4833-a26b-bd0f2d84f27f service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:49.295669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1181/2351] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:46:49.651962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:49.653530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:49.678023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae902606-cc1a-40a3-bd17-8e23801e9d30 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:49.686914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:49.687863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:49.689521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:49.689842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] PATH_INFO: `/v3/projects/c64a2cf8a2684547a4d198fc7435bac9` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:49.691099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64a2cf8a2684547a4d198fc7435bac9)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:49.693025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:49.751300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64a2cf8a2684547a4d198fc7435bac9', 'request_id': 'req-1961e224-197c-4ccd-a14a-9a68b052c56e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.761589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64a2cf8a2684547a4d198fc7435bac9', 'request_id': 'req-1961e224-197c-4ccd-a14a-9a68b052c56e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.768201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64a2cf8a2684547a4d198fc7435bac9', 'request_id': 'req-1961e224-197c-4ccd-a14a-9a68b052c56e'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.778799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] The token cache is being invalidate because project c64a2cf8a2684547a4d198fc7435bac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:46:49.779155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.779927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1961e224-197c-4ccd-a14a-9a68b052c56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:46:49.781909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1171/2352] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:46:49 2022] DELETE /identity/v3/projects/c64a2cf8a2684547a4d198fc7435bac9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:46:49.788066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69855e0-b441-41da-910b-a96cd1c23576 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:49.788383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69855e0-b441-41da-910b-a96cd1c23576 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:49.788690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69855e0-b441-41da-910b-a96cd1c23576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:49.810499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b69855e0-b441-41da-910b-a96cd1c23576 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:49.811725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b69855e0-b441-41da-910b-a96cd1c23576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:49.899401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1182/2353] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:49.906971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68895e6-ce53-4c04-84b3-4246c1552570 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:49.907357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68895e6-ce53-4c04-84b3-4246c1552570 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:49.907655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68895e6-ce53-4c04-84b3-4246c1552570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:49.928306 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e68895e6-ce53-4c04-84b3-4246c1552570 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:49.929679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e68895e6-ce53-4c04-84b3-4246c1552570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:49.941775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1172/2354] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:49.945545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69855e0-b441-41da-910b-a96cd1c23576 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:49.956900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69855e0-b441-41da-910b-a96cd1c23576 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:49.962245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:49.963696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:49.964099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:49.964478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:49.965491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:46:49.965944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:49.967672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:49.980696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1183/2355] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:46:49.985512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68895e6-ce53-4c04-84b3-4246c1552570 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:49.995938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68895e6-ce53-4c04-84b3-4246c1552570 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:50.000682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:50.001613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:50.001935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:50.002208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:50.002914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:50.004828 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:50.040949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1173/2356] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:46:49 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:50.045585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:50.055582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c052c-0996-428c-a56c-62bd620766be admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:50.114691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:50.115368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:50.115650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:50.115924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:50.116623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:50.118590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:50.140127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1184/2357] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:46:50 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:46:50.144162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:50.157234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45d801-56b4-460b-88ae-cc05054866b4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:50.163420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:50.164355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:50.164641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:50.164929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:50.165668 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:50.168101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:50.184522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1174/2358] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:46:50.188495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:50.201212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e860b-b60d-4b76-87be-7ff80510ac76 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:50.211986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bf8bd-4bfa-435a-909f-5676623ff540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:50.212686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bf8bd-4bfa-435a-909f-5676623ff540 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:50.212962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bf8bd-4bfa-435a-909f-5676623ff540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:50.213796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bf8bd-4bfa-435a-909f-5676623ff540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:50.214530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bf8bd-4bfa-435a-909f-5676623ff540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:50.216149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bf8bd-4bfa-435a-909f-5676623ff540 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:50.233077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1185/2359] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:46:50.237147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:50.247694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82996-8aed-4702-8def-f800fab10715 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:50.252456 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:50.253334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:50.253621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:50.253934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] PATH_INFO: `/v3/projects/c127cd11a4ba4f8b8417d98d4f68669f/users/f1d239b4b4314680ab43a8687be33066/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:50.268288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c127cd11a4ba4f8b8417d98d4f68669f, user_id=f1d239b4b4314680ab43a8687be33066, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:50.270989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:50.289160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1175/2360] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:46:50 2022] PUT /identity/v3/projects/c127cd11a4ba4f8b8417d98d4f68669f/users/f1d239b4b4314680ab43a8687be33066/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:46:50.298811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8531b4-0d72-4ebf-9b11-6eab58b8371c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:50.302942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8531b4-0d72-4ebf-9b11-6eab58b8371c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:50.303630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8531b4-0d72-4ebf-9b11-6eab58b8371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:50.334896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2f8531b4-0d72-4ebf-9b11-6eab58b8371c None None] MFA Rules not processed for user `f1d239b4b4314680ab43a8687be33066`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:46:50.338975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2f8531b4-0d72-4ebf-9b11-6eab58b8371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:50.410622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1186/2361] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:46:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:46:50.424964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:46:50.427677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:46:50.507146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742aa4-08b5-48e8-a02a-645865cb9d5a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:46:50.511694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07e952-9b76-4188-8a7f-4036cc3efb22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:46:50.512497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07e952-9b76-4188-8a7f-4036cc3efb22 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:46:50.512778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07e952-9b76-4188-8a7f-4036cc3efb22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:46:50.513052 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07e952-9b76-4188-8a7f-4036cc3efb22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:46:50.522240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07e952-9b76-4188-8a7f-4036cc3efb22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:46:50.523851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07e952-9b76-4188-8a7f-4036cc3efb22 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:46:50.534458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1176/2362] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:46:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:09.938466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8531b4-0d72-4ebf-9b11-6eab58b8371c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:10.046668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8531b4-0d72-4ebf-9b11-6eab58b8371c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:10.051994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:10.052874 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:10.053161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:10.053441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] PATH_INFO: `/v3/users/f1d239b4b4314680ab43a8687be33066` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:10.054743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d239b4b4314680ab43a8687be33066)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:10.056722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:10.101968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d239b4b4314680ab43a8687be33066'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.110360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d239b4b4314680ab43a8687be33066'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.111002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d239b4b4314680ab43a8687be33066'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.123228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d239b4b4314680ab43a8687be33066'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.123892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d239b4b4314680ab43a8687be33066'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.135924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1187/2363] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:47:09 2022] DELETE /identity/v3/users/f1d239b4b4314680ab43a8687be33066 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:47:10.140380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:10.140873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:10.140873 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:10.188499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:10.189726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:10.249586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1177/2364] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:47:10.259126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:10.260539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:10.351507 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d6a0e-8fb3-4892-aa4d-692911441d85 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:10.355688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:10.356328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:10.356609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:10.356883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:10.365624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:10.367077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:10.376868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1188/2365] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:10.638897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:10.640329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:10.652603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202af0b2-6c24-4f34-a96f-c270b3e8c46d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:10.658691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:10.659629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:10.659916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:10.660194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] PATH_INFO: `/v3/projects/c127cd11a4ba4f8b8417d98d4f68669f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:10.661384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c127cd11a4ba4f8b8417d98d4f68669f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:10.663322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:10.710509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c127cd11a4ba4f8b8417d98d4f68669f', 'request_id': 'req-137c28c5-2955-4ef4-8ff1-c09a2a105f48'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.722815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c127cd11a4ba4f8b8417d98d4f68669f', 'request_id': 'req-137c28c5-2955-4ef4-8ff1-c09a2a105f48'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.730343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c127cd11a4ba4f8b8417d98d4f68669f', 'request_id': 'req-137c28c5-2955-4ef4-8ff1-c09a2a105f48'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.740891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] The token cache is being invalidate because project c127cd11a4ba4f8b8417d98d4f68669f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:47:10.740891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.742039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-137c28c5-2955-4ef4-8ff1-c09a2a105f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:10.743568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1178/2366] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:47:10 2022] DELETE /identity/v3/projects/c127cd11a4ba4f8b8417d98d4f68669f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:18.316637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:18.318376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:18.337948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6721d-fa0c-4f65-b103-22a51c6c7769 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:18.409188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:18.410231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:18.410546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:18.410801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] PATH_INFO: `/v3/users/26470c593c834210ac502d4fa2e7907d` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:18.412697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26470c593c834210ac502d4fa2e7907d)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:18.414726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:18.476382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26470c593c834210ac502d4fa2e7907d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:18.485397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26470c593c834210ac502d4fa2e7907d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:18.486160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26470c593c834210ac502d4fa2e7907d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:18.500694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26470c593c834210ac502d4fa2e7907d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:18.501419 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26470c593c834210ac502d4fa2e7907d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:18.515540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1189/2367] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:47:18 2022] DELETE /identity/v3/users/26470c593c834210ac502d4fa2e7907d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:18.519971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c279-e208-4382-b2ec-3a7aafe3960b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:18.520490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c279-e208-4382-b2ec-3a7aafe3960b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:18.520594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c279-e208-4382-b2ec-3a7aafe3960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:18.539037 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-1cc8c279-e208-4382-b2ec-3a7aafe3960b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:18.540752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1cc8c279-e208-4382-b2ec-3a7aafe3960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:18.606532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1179/2368] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:18.621188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:18.622853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:18.697129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bcc28-3529-462d-a75c-b11d836c74c5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:18.703606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:18.704401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:18.704857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:18.705212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:18.717597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888dbe-d156-4f6b-b7d3-26bee30bcecb None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:18.717909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888dbe-d156-4f6b-b7d3-26bee30bcecb None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:18.718259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888dbe-d156-4f6b-b7d3-26bee30bcecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:18.724456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:18.725882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:18.736584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1190/2369] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:47:18.737575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-99888dbe-d156-4f6b-b7d3-26bee30bcecb None None] MFA Rules not processed for user `af0e1282e6024c9c8f128a8d7b235733`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:18.738886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-99888dbe-d156-4f6b-b7d3-26bee30bcecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:18.802996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1180/2370] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:47:19.055298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.056766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:19.081369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5755f-86d6-4ed2-a718-3810734cce34 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.087493 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.088911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.089213 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.089511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] PATH_INFO: `/v3/projects/68baf63becdb45609e62f9a4e861dcae` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.090849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68baf63becdb45609e62f9a4e861dcae)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.092769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.145337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68baf63becdb45609e62f9a4e861dcae', 'request_id': 'req-f4e98479-fb48-437e-912f-b86446501b86'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:19.155141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68baf63becdb45609e62f9a4e861dcae', 'request_id': 'req-f4e98479-fb48-437e-912f-b86446501b86'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:19.161875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68baf63becdb45609e62f9a4e861dcae', 'request_id': 'req-f4e98479-fb48-437e-912f-b86446501b86'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:19.172957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] The token cache is being invalidate because project 68baf63becdb45609e62f9a4e861dcae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:47:19.173252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:19.173945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f4e98479-fb48-437e-912f-b86446501b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:19.175800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1191/2371] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:47:19 2022] DELETE /identity/v3/projects/68baf63becdb45609e62f9a4e861dcae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:19.180580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3234ec6-08d7-4c53-bc65-fcd55345ef3a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.181073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3234ec6-08d7-4c53-bc65-fcd55345ef3a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.181527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3234ec6-08d7-4c53-bc65-fcd55345ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.232225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b3234ec6-08d7-4c53-bc65-fcd55345ef3a None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:19.233453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b3234ec6-08d7-4c53-bc65-fcd55345ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:19.292436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1181/2372] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:19.300155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f992c-583d-4e04-bc22-3f77f2fc4bcd None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.300448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f992c-583d-4e04-bc22-3f77f2fc4bcd None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.300730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f992c-583d-4e04-bc22-3f77f2fc4bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.318678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8f3f992c-583d-4e04-bc22-3f77f2fc4bcd None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:19.319883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8f3f992c-583d-4e04-bc22-3f77f2fc4bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:19.329073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1192/2373] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:47:19.333417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3234ec6-08d7-4c53-bc65-fcd55345ef3a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.343759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3234ec6-08d7-4c53-bc65-fcd55345ef3a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.348257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.349090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.349370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.349642 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.350399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:47:19.350703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.352277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.365120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1182/2374] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:47:19.374912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f992c-583d-4e04-bc22-3f77f2fc4bcd None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.383968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f992c-583d-4e04-bc22-3f77f2fc4bcd None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.389584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.390278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.390562 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.390839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.391528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.393503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.424307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1193/2375] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:47:19 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:47:19.425885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.438129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a89e5-abc4-474e-8c35-7461822906f0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.507477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.508356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.508644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.508922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.510735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.512688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.542981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1183/2376] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:47:19 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:47:19.544140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.555384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5e2c9-906d-4f89-8d54-db1682600f59 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.560859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.562500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.562793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.563073 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.564334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.566164 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.578701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1194/2377] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:47:19.582980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.593862 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e52ed-7973-4c5e-8c94-aec142d3a9e5 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.599199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52dee-30cb-4b67-825a-258303d05814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.600204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52dee-30cb-4b67-825a-258303d05814 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.600993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52dee-30cb-4b67-825a-258303d05814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.601819 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52dee-30cb-4b67-825a-258303d05814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.602801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52dee-30cb-4b67-825a-258303d05814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.604576 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52dee-30cb-4b67-825a-258303d05814 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.615693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1184/2378] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:47:19.620379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.630958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3b6c3-897a-45b3-b938-6114a44bf2b1 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.636334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.637195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.637478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.637791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] PATH_INFO: `/v3/projects/23f5a1e423684eceb1ffda8f4a329328/users/8037d28e6c364b2e96e7c2ea6c04e56c/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.653438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f5a1e423684eceb1ffda8f4a329328, user_id=8037d28e6c364b2e96e7c2ea6c04e56c, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.656188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.668749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1195/2379] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:47:19 2022] PUT /identity/v3/projects/23f5a1e423684eceb1ffda8f4a329328/users/8037d28e6c364b2e96e7c2ea6c04e56c/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:19.680681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ec462-1e7b-4eae-aca4-5afccb30ee4e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.680973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ec462-1e7b-4eae-aca4-5afccb30ee4e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.681253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ec462-1e7b-4eae-aca4-5afccb30ee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.709874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e35ec462-1e7b-4eae-aca4-5afccb30ee4e None None] MFA Rules not processed for user `8037d28e6c364b2e96e7c2ea6c04e56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:19.711191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e35ec462-1e7b-4eae-aca4-5afccb30ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:19.778351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1185/2380] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:19.789473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:19.791852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:19.858843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5278-3319-4609-8fe5-a0fd91bda9bb admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:19.862471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:19.863106 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:19.863385 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:19.863658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:19.872514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:19.873993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:19.882898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1196/2381] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:23.150213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:23.151221 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:23.151439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:23.182350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:23.183554 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:23.254017 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1186/2382] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:23.276938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:23.278384 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:23.345325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8fe4a-f283-4e88-a0c5-073b4120aa31 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:23.350234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd32f14-1ec2-4fb0-893b-c743a7cc4db5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:23.350873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32f14-1ec2-4fb0-893b-c743a7cc4db5 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:23.351150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32f14-1ec2-4fb0-893b-c743a7cc4db5 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:23.351422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32f14-1ec2-4fb0-893b-c743a7cc4db5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:23.359846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd32f14-1ec2-4fb0-893b-c743a7cc4db5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:23.361431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd32f14-1ec2-4fb0-893b-c743a7cc4db5 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:23.369582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1197/2383] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:47:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:47:26.036867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:26.038449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:26.134445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9615e20-4a30-4d1b-a55e-2996bec61262 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:26.138635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:26.139807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:26.140266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:26.140705 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:26.143407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:26.236236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:26.238122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:26.257523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1187/2384] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:32.134245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e37d69-17d6-46db-bd6b-9ce546d07881 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:32.135437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e37d69-17d6-46db-bd6b-9ce546d07881 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:32.135794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e37d69-17d6-46db-bd6b-9ce546d07881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:32.156479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e4e37d69-17d6-46db-bd6b-9ce546d07881 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:32.158760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e4e37d69-17d6-46db-bd6b-9ce546d07881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:32.166686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1198/2385] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:47:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:32.192143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:32.208949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df893-4962-4da8-99ec-efe82ca274d4 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:32.224695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813bc90-6267-45c2-87b6-f9f0d5c218b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:32.225364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813bc90-6267-45c2-87b6-f9f0d5c218b9 service swift] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:32.225646 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813bc90-6267-45c2-87b6-f9f0d5c218b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:32.225964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813bc90-6267-45c2-87b6-f9f0d5c218b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:32.248064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813bc90-6267-45c2-87b6-f9f0d5c218b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:32.250205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813bc90-6267-45c2-87b6-f9f0d5c218b9 service swift] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:32.277647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1188/2386] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:47:34.668941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e37d69-17d6-46db-bd6b-9ce546d07881 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:34.750795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e37d69-17d6-46db-bd6b-9ce546d07881 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:34.759465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:34.760558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:34.760906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:34.761303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] PATH_INFO: `/v3/users/8037d28e6c364b2e96e7c2ea6c04e56c` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:34.762674 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8037d28e6c364b2e96e7c2ea6c04e56c)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:34.765203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:34.857530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8037d28e6c364b2e96e7c2ea6c04e56c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:34.871447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8037d28e6c364b2e96e7c2ea6c04e56c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:34.876204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8037d28e6c364b2e96e7c2ea6c04e56c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:34.908894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8037d28e6c364b2e96e7c2ea6c04e56c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:34.911344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8037d28e6c364b2e96e7c2ea6c04e56c'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:34.952817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1199/2387] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:47:34 2022] DELETE /identity/v3/users/8037d28e6c364b2e96e7c2ea6c04e56c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:34.954626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:34.955120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:34.955208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:34.994957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:34.996212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:35.171211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1189/2388] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:35.181951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:35.183407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:35.355615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21922-ab7a-4417-b828-99cec67fe8a4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:35.373241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763fa8-124d-4d2b-a18f-01fc00a45ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:35.373936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763fa8-124d-4d2b-a18f-01fc00a45ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:35.374216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763fa8-124d-4d2b-a18f-01fc00a45ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:35.374489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763fa8-124d-4d2b-a18f-01fc00a45ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:35.401457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af763fa8-124d-4d2b-a18f-01fc00a45ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:35.403013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af763fa8-124d-4d2b-a18f-01fc00a45ecf service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:35.427700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1200/2389] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:36.142981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:36.144586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:36.166790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79d6c2-070e-4f18-b9e5-4a4fac20a08e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:36.186462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:36.188567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:36.189018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:36.189561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] PATH_INFO: `/v3/projects/23f5a1e423684eceb1ffda8f4a329328` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:36.191183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f5a1e423684eceb1ffda8f4a329328)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:36.193601 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:36.339169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f5a1e423684eceb1ffda8f4a329328', 'request_id': 'req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:36.354585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f5a1e423684eceb1ffda8f4a329328', 'request_id': 'req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:36.370420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f5a1e423684eceb1ffda8f4a329328', 'request_id': 'req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:36.408374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] The token cache is being invalidate because project 23f5a1e423684eceb1ffda8f4a329328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:47:36.408980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:36.410820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4e13f0e5-aa4a-491b-bba6-1bbe6203096b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:36.415630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1190/2390] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:47:36 2022] DELETE /identity/v3/projects/23f5a1e423684eceb1ffda8f4a329328 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:43.824159 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937aeb4-c647-45eb-ad89-621f6c89e601 None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:43.824809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937aeb4-c647-45eb-ad89-621f6c89e601 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:43.824925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937aeb4-c647-45eb-ad89-621f6c89e601 None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:43.826986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1201/2391] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:47:43.836596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20ac0-5bc0-41ef-85ab-d1b31de5d25a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:43.837201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20ac0-5bc0-41ef-85ab-d1b31de5d25a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:43.838861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20ac0-5bc0-41ef-85ab-d1b31de5d25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:43.944156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-1da20ac0-5bc0-41ef-85ab-d1b31de5d25a None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:43.945489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1da20ac0-5bc0-41ef-85ab-d1b31de5d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:44.062295 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1191/2392] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:47:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:44.077180 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937aeb4-c647-45eb-ad89-621f6c89e601 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:44.079047 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1937aeb4-c647-45eb-ad89-621f6c89e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:44.147837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937aeb4-c647-45eb-ad89-621f6c89e601 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:44.151543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9d56d-3c25-4c41-89a0-558351360dbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7291e3af37548efafd5e4654569677b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:44.152182 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9d56d-3c25-4c41-89a0-558351360dbc service glance] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:44.152470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9d56d-3c25-4c41-89a0-558351360dbc service glance] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:44.152740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9d56d-3c25-4c41-89a0-558351360dbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:44.164210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9d56d-3c25-4c41-89a0-558351360dbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:44.166040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9d56d-3c25-4c41-89a0-558351360dbc service glance] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:44.178564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1202/2393] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:44.276410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e3b5-0171-480d-9db8-cbf04ce54008 None None] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:44.276702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e3b5-0171-480d-9db8-cbf04ce54008 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:44.276993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e3b5-0171-480d-9db8-cbf04ce54008 None None] PATH_INFO: `/` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:44.278518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1192/2394] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:47:44.285038 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81542-29fe-4419-8073-29711823d662 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:44.285875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81542-29fe-4419-8073-29711823d662 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:44.286338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81542-29fe-4419-8073-29711823d662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:44.307486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-0bc81542-29fe-4419-8073-29711823d662 None None] MFA Rules not processed for user `9c1c4e1fe220486ab672b3dea6ffdfec`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:44.308745 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0bc81542-29fe-4419-8073-29711823d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:44.365813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1203/2395] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:47:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:44.380549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271e3b5-0171-480d-9db8-cbf04ce54008 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:44.383116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d271e3b5-0171-480d-9db8-cbf04ce54008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:44.401866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271e3b5-0171-480d-9db8-cbf04ce54008 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:44.405648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417484b-ddb3-496e-a916-b7c77af6a5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:44.406474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417484b-ddb3-496e-a916-b7c77af6a5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:44.406756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417484b-ddb3-496e-a916-b7c77af6a5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:44.407034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417484b-ddb3-496e-a916-b7c77af6a5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:44.415978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417484b-ddb3-496e-a916-b7c77af6a5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:44.417620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417484b-ddb3-496e-a916-b7c77af6a5f4 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:44.427001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1193/2396] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:44.533472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b74df-b1a6-4e4e-a6c5-f10c88a4d47b None None] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:44.534475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b74df-b1a6-4e4e-a6c5-f10c88a4d47b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:44.536286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b74df-b1a6-4e4e-a6c5-f10c88a4d47b None None] PATH_INFO: `/` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:44.539062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1204/2397] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 12 11:47:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 11:47:44.547493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f30e6-f384-409e-a4e3-e4eba02e1d08 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:44.547889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f30e6-f384-409e-a4e3-e4eba02e1d08 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:44.548039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f30e6-f384-409e-a4e3-e4eba02e1d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:44.568579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-978f30e6-f384-409e-a4e3-e4eba02e1d08 None None] MFA Rules not processed for user `59372ef7ca2d439c8a2c12e29f8d97bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:44.569895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-978f30e6-f384-409e-a4e3-e4eba02e1d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:44.582394 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1194/2398] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 12 11:47:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:44.597290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b74df-b1a6-4e4e-a6c5-f10c88a4d47b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:44.599868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c39b74df-b1a6-4e4e-a6c5-f10c88a4d47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:44.618140 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b74df-b1a6-4e4e-a6c5-f10c88a4d47b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:44.623502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:44.624237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:44.624616 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:44.625033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:44.638838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:44.640402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:44.652734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1205/2399] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:48.572855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030992c6-4f0f-4250-926d-f39d739829c0 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:48.573588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030992c6-4f0f-4250-926d-f39d739829c0 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:48.573588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030992c6-4f0f-4250-926d-f39d739829c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:48.643724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-030992c6-4f0f-4250-926d-f39d739829c0 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:48.645105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-030992c6-4f0f-4250-926d-f39d739829c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:48.726524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1195/2400] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:47:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:48.756086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:48.757521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:48.970876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c6bea-60f2-4479-a908-5ad429ff40bd service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:48.976578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:48.977236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:48.977552 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:48.978626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:49.005950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:49.007650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:49.020907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1206/2401] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:47:51.229572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f460-906b-41f1-8864-32d149755402 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:51.230088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f460-906b-41f1-8864-32d149755402 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:51.230192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f460-906b-41f1-8864-32d149755402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:51.253860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c308f460-906b-41f1-8864-32d149755402 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:51.255190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c308f460-906b-41f1-8864-32d149755402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:51.264722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1196/2402] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 12 11:47:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:51.276685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:51.287537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348243a-444c-406b-b39c-f7725f6cb7d1 service swift] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:51.303947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:51.304601 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:51.304880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:51.305153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:51.322203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:51.323966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:51.339126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1207/2403] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:47:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:47:53.434161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308f460-906b-41f1-8864-32d149755402 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:53.435584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c308f460-906b-41f1-8864-32d149755402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:53.519075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308f460-906b-41f1-8864-32d149755402 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:53.523991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:53.524967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:53.525236 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:53.525520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] PATH_INFO: `/v3/users/47030b2f71c64e8884d1946f4ed2afdd` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:53.527143 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47030b2f71c64e8884d1946f4ed2afdd)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:53.529099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:53.578402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47030b2f71c64e8884d1946f4ed2afdd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:53.589023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47030b2f71c64e8884d1946f4ed2afdd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:53.594134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47030b2f71c64e8884d1946f4ed2afdd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:53.608846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47030b2f71c64e8884d1946f4ed2afdd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:53.609589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a060968c-fa38-4e68-93fa-9f57145fc425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47030b2f71c64e8884d1946f4ed2afdd'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:53.623213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1197/2404] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:47:53 2022] DELETE /identity/v3/users/47030b2f71c64e8884d1946f4ed2afdd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:53.921063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:53.943659 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6e613-7ada-47da-83b2-146a38c18d77 service swift] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.010980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.012286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.012808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.013319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] PATH_INFO: `/v3/projects/d83add10bc914fa2b53b93c94671c2cd` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.014824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83add10bc914fa2b53b93c94671c2cd)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.016756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.064400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83add10bc914fa2b53b93c94671c2cd', 'request_id': 'req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:54.074629 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83add10bc914fa2b53b93c94671c2cd', 'request_id': 'req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:54.082606 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83add10bc914fa2b53b93c94671c2cd', 'request_id': 'req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:54.093251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] The token cache is being invalidate because project d83add10bc914fa2b53b93c94671c2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:47:54.093539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:54.094244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b27b3f39-31c6-42e2-bd49-98ae9f8e913e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:54.095798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1208/2405] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:47:53 2022] DELETE /identity/v3/projects/d83add10bc914fa2b53b93c94671c2cd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:54.100608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c35c1-bbef-420d-ac22-d4d62c9387c6 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.100902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c35c1-bbef-420d-ac22-d4d62c9387c6 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.101181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c35c1-bbef-420d-ac22-d4d62c9387c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.120823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-602c35c1-bbef-420d-ac22-d4d62c9387c6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:54.122270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-602c35c1-bbef-420d-ac22-d4d62c9387c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:54.188133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1198/2406] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:54.200271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b477de-2e7a-40d2-ad49-b9b51d37a757 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.200580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b477de-2e7a-40d2-ad49-b9b51d37a757 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.200889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b477de-2e7a-40d2-ad49-b9b51d37a757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.236733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e8b477de-2e7a-40d2-ad49-b9b51d37a757 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:54.238499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e8b477de-2e7a-40d2-ad49-b9b51d37a757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:54.260191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1209/2407] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:54.264742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c35c1-bbef-420d-ac22-d4d62c9387c6 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:54.274965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c35c1-bbef-420d-ac22-d4d62c9387c6 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.279629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.280292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.280711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.280996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.281815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:47:54.282129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.283749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.297122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1199/2408] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:47:54.302330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b477de-2e7a-40d2-ad49-b9b51d37a757 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:54.312311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b477de-2e7a-40d2-ad49-b9b51d37a757 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.317375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.318078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.318363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.318644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.319344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.321998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.355979 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1210/2409] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:47:54 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:47:54.357585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:54.367749 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ebd36-6d56-44ce-918d-c6121fa7ea13 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.422812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.423476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.423754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.424025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.424733 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.426681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.453735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1200/2410] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:47:54 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:47:54.455694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:54.466961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a3541-5315-4199-9e68-e17544e1f06e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.471648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.472311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.472598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.472881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.473613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.475400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.490958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1211/2411] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:47:54.492034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:54.511754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd91fe4-e938-4cc4-b2b8-0fa85a546d2c admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.516895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df444e81-8ac6-47c2-844c-87d31453a689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.517592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444e81-8ac6-47c2-844c-87d31453a689 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.517925 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444e81-8ac6-47c2-844c-87d31453a689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.518205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444e81-8ac6-47c2-844c-87d31453a689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.518939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444e81-8ac6-47c2-844c-87d31453a689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.520580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444e81-8ac6-47c2-844c-87d31453a689 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.531135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1201/2412] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:47:54.535367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:54.545868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959346-5271-4fe5-9e5f-e78a90965a98 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.550723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.551757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.552064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.552350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] PATH_INFO: `/v3/projects/aee406d452d84c85bc6e343a5563b942/users/51ef3bad84fc4932a64ddae3d69971e2/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.568442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee406d452d84c85bc6e343a5563b942, user_id=51ef3bad84fc4932a64ddae3d69971e2, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.571239 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.585252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1212/2413] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:47:54 2022] PUT /identity/v3/projects/aee406d452d84c85bc6e343a5563b942/users/51ef3bad84fc4932a64ddae3d69971e2/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:54.595125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6c61-3212-4c2d-a2af-06cbf8696338 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.595423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6c61-3212-4c2d-a2af-06cbf8696338 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.595711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6c61-3212-4c2d-a2af-06cbf8696338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.622616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-379a6c61-3212-4c2d-a2af-06cbf8696338 None None] MFA Rules not processed for user `51ef3bad84fc4932a64ddae3d69971e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:54.623799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-379a6c61-3212-4c2d-a2af-06cbf8696338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:54.692327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1202/2414] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:47:54.704971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:54.706704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:54.804303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae91b9f-67b2-4e6b-8653-a8cfaa90e9dd admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:54.808191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae127-b94b-4768-a1c1-dec8ec1795d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:54.808833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae127-b94b-4768-a1c1-dec8ec1795d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:54.809111 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae127-b94b-4768-a1c1-dec8ec1795d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:54.809382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae127-b94b-4768-a1c1-dec8ec1795d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:54.818304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ae127-b94b-4768-a1c1-dec8ec1795d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:54.819754 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ae127-b94b-4768-a1c1-dec8ec1795d7 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:54.839522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1213/2415] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:57.529335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a6c61-3212-4c2d-a2af-06cbf8696338 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:57.597663 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a6c61-3212-4c2d-a2af-06cbf8696338 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:57.611934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:57.613170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:57.613516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:57.613893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] PATH_INFO: `/v3/users/51ef3bad84fc4932a64ddae3d69971e2` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:57.615204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ef3bad84fc4932a64ddae3d69971e2)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:57.617265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:57.675173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ef3bad84fc4932a64ddae3d69971e2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:57.685745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ef3bad84fc4932a64ddae3d69971e2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:57.685745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ef3bad84fc4932a64ddae3d69971e2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:57.704066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ef3bad84fc4932a64ddae3d69971e2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:57.705180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ef3bad84fc4932a64ddae3d69971e2'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:57.722612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1203/2416] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:47:57 2022] DELETE /identity/v3/users/51ef3bad84fc4932a64ddae3d69971e2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:57.727223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:57.727751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:57.728487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:57.746689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:57.747999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:57.814352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1214/2417] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:57.824231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:57.825658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:57.881389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98578-79b6-466f-a23a-71fe5006364b admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:57.885103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643549c-1905-46d6-9800-553e198131d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:57.885818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643549c-1905-46d6-9800-553e198131d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:57.886114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643549c-1905-46d6-9800-553e198131d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:57.886389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643549c-1905-46d6-9800-553e198131d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:57.896418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643549c-1905-46d6-9800-553e198131d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:57.897904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643549c-1905-46d6-9800-553e198131d0 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:57.909461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1204/2418] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:58.191488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.193313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:58.209223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be0f1-2226-433d-bcd4-891b5bfe05b7 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:58.216539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:58.217792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.218331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.218809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] PATH_INFO: `/v3/projects/aee406d452d84c85bc6e343a5563b942` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.220367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee406d452d84c85bc6e343a5563b942)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:58.223125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:58.271986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee406d452d84c85bc6e343a5563b942', 'request_id': 'req-8bcfed8e-c640-44ad-a547-e12d60261b0a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:58.280412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee406d452d84c85bc6e343a5563b942', 'request_id': 'req-8bcfed8e-c640-44ad-a547-e12d60261b0a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:58.295266 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee406d452d84c85bc6e343a5563b942', 'request_id': 'req-8bcfed8e-c640-44ad-a547-e12d60261b0a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:58.306530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] The token cache is being invalidate because project aee406d452d84c85bc6e343a5563b942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:47:58.307008 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:58.307938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8bcfed8e-c640-44ad-a547-e12d60261b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:47:58.309963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1215/2419] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:47:58 2022] DELETE /identity/v3/projects/aee406d452d84c85bc6e343a5563b942 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:47:58.314976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766bd0f-6afd-4595-a332-edb5a9096b0b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.315351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766bd0f-6afd-4595-a332-edb5a9096b0b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.315699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766bd0f-6afd-4595-a332-edb5a9096b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.336540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-a766bd0f-6afd-4595-a332-edb5a9096b0b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:58.338488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a766bd0f-6afd-4595-a332-edb5a9096b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:58.415850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1205/2420] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:58.424382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2ac53-d3cf-4e3e-a7f2-c3beaa2e2575 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.424835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2ac53-d3cf-4e3e-a7f2-c3beaa2e2575 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.425251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2ac53-d3cf-4e3e-a7f2-c3beaa2e2575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.449229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-84a2ac53-d3cf-4e3e-a7f2-c3beaa2e2575 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:58.450641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-84a2ac53-d3cf-4e3e-a7f2-c3beaa2e2575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:58.463386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1216/2421] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:58.464615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766bd0f-6afd-4595-a332-edb5a9096b0b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.474961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766bd0f-6afd-4595-a332-edb5a9096b0b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:58.479635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:58.480299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.480582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.480860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.481589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:47:58.481946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:58.483566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:58.515793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1206/2422] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:47:58.519777 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2ac53-d3cf-4e3e-a7f2-c3beaa2e2575 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.530098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2ac53-d3cf-4e3e-a7f2-c3beaa2e2575 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:58.535765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:58.536442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.536728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.537007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.537759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:58.539726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:58.600455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1217/2423] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:47:58 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:47:58.605175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.628658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c793d76-2418-4644-90f4-24169d890b91 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:58.715847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:58.716670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.717029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.717380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.718316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:58.720590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:58.745034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1207/2424] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:47:58 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:47:58.749724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.760118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe677-f8d6-4a71-a971-861f81d7fc36 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:58.765054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:58.765722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.766030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.766310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.767036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:58.768633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:58.779685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1218/2425] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:47:58.784246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.795673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0b109-e9a3-41fd-8f69-9def9a918ec3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:58.800377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9bc1c-ae0f-4da2-8b0d-c49c205c7765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:58.801040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9bc1c-ae0f-4da2-8b0d-c49c205c7765 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.801323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9bc1c-ae0f-4da2-8b0d-c49c205c7765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.801619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9bc1c-ae0f-4da2-8b0d-c49c205c7765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.802362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9bc1c-ae0f-4da2-8b0d-c49c205c7765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:58.803983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9bc1c-ae0f-4da2-8b0d-c49c205c7765 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:58.817034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1208/2426] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:47:58.821328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.831511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c04ae-c971-4bcf-b4af-56fff1621a6b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:58.836322 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:58.837175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.837483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.837785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] PATH_INFO: `/v3/projects/7a1abe690e43433daccff30391d4b260/users/70abbcb3651945609f0e65237135f3e7/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.852030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1abe690e43433daccff30391d4b260, user_id=70abbcb3651945609f0e65237135f3e7, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:58.855184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:58.871268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1219/2427] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:47:58 2022] PUT /identity/v3/projects/7a1abe690e43433daccff30391d4b260/users/70abbcb3651945609f0e65237135f3e7/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:47:58.876876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d312-3bff-4c85-8c37-047a2c631a60 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:58.877161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d312-3bff-4c85-8c37-047a2c631a60 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:58.877437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d312-3bff-4c85-8c37-047a2c631a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:58.894110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0e83d312-3bff-4c85-8c37-047a2c631a60 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:58.895305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0e83d312-3bff-4c85-8c37-047a2c631a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:58.953778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1209/2428] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:58.963339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:58.964999 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:59.019039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d889-25d9-44d7-8b29-1a319a21294c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:59.022641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:59.023267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:59.023545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:59.023814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:59.033184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:59.034945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:59.044936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1220/2429] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:47:59.618022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271d89-542b-4146-b7c6-32bfe4782156 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:59.618577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271d89-542b-4146-b7c6-32bfe4782156 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:59.618577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271d89-542b-4146-b7c6-32bfe4782156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:59.645242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-17271d89-542b-4146-b7c6-32bfe4782156 None None] MFA Rules not processed for user `70abbcb3651945609f0e65237135f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:47:59.646556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-17271d89-542b-4146-b7c6-32bfe4782156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:59.721489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1210/2430] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:47:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:47:59.733490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:47:59.734836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:47:59.814796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0be2-d7f8-4791-9727-77cddee891f5 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:47:59.818544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:47:59.819185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:47:59.819654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:47:59.820101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:47:59.832470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:47:59.834784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:47:59.846554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1221/2431] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:47:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:48:01.193679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2664301-1918-4037-9e85-37a00e65e91b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:48:01.194217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2664301-1918-4037-9e85-37a00e65e91b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:48:01.194315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2664301-1918-4037-9e85-37a00e65e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:48:01.213107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e2664301-1918-4037-9e85-37a00e65e91b None None] MFA Rules not processed for user `70abbcb3651945609f0e65237135f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:48:01.214433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e2664301-1918-4037-9e85-37a00e65e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:48:01.221941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1211/2432] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:48:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:48:01.470908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:48:01.472391 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:48:01.582852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340624a-2389-48b1-826a-497ede197423 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:48:01.589383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:48:01.590783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:48:01.591077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:48:01.591506 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:48:01.594181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:48:01.605989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:48:01.607581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:48:01.619085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1222/2433] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:48:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:48:14.314957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb5b5-1b7b-4791-9e23-0ba807df9b2c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:48:14.315424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb5b5-1b7b-4791-9e23-0ba807df9b2c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:48:14.315536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb5b5-1b7b-4791-9e23-0ba807df9b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:48:14.333499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-73dbb5b5-1b7b-4791-9e23-0ba807df9b2c None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:48:14.334726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-73dbb5b5-1b7b-4791-9e23-0ba807df9b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:48:14.392639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1212/2434] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 12 11:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:48:14.406236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:48:14.408317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:48:14.477365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375972da-a241-4798-8454-4fd1c5f99314 service placement] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:48:14.483589 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e9c5-6384-4367-a196-4f62d40ef279 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:48:14.484240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e9c5-6384-4367-a196-4f62d40ef279 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:48:14.484525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e9c5-6384-4367-a196-4f62d40ef279 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:48:14.484803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e9c5-6384-4367-a196-4f62d40ef279 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:48:14.495853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e9c5-6384-4367-a196-4f62d40ef279 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:48:14.497466 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e9c5-6384-4367-a196-4f62d40ef279 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:48:14.506741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1223/2435] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 11:49:00.985422 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dea23-5791-4b4d-9065-d7a9bd2e750f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:00.985972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dea23-5791-4b4d-9065-d7a9bd2e750f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:00.986088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dea23-5791-4b4d-9065-d7a9bd2e750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:01.003815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e71dea23-5791-4b4d-9065-d7a9bd2e750f None None] MFA Rules not processed for user `af0e1282e6024c9c8f128a8d7b235733`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:01.005003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e71dea23-5791-4b4d-9065-d7a9bd2e750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:01.057342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1213/2436] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:49:17.663510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda72c-2ce9-4279-91ab-3fc87813614d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:17.664091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda72c-2ce9-4279-91ab-3fc87813614d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:17.664469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda72c-2ce9-4279-91ab-3fc87813614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:17.682001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7dfda72c-2ce9-4279-91ab-3fc87813614d None None] MFA Rules not processed for user `70abbcb3651945609f0e65237135f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:17.683198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7dfda72c-2ce9-4279-91ab-3fc87813614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:17.690939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1224/2437] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:49:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:49:26.399417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50dce6-a9a5-43dc-a367-267e971e09f1 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:26.399917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50dce6-a9a5-43dc-a367-267e971e09f1 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:26.400024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50dce6-a9a5-43dc-a367-267e971e09f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:26.417900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ea50dce6-a9a5-43dc-a367-267e971e09f1 None None] MFA Rules not processed for user `635d1cf64110483b843b01e6e6ddc749`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:26.419874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ea50dce6-a9a5-43dc-a367-267e971e09f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:26.488932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1214/2438] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:49:40.684990 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:40.685485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:40.685578 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:40.702681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:40.704145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:40.711352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1225/2439] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 12 11:49:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:49:40.759926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50dce6-a9a5-43dc-a367-267e971e09f1 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:40.772438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50dce6-a9a5-43dc-a367-267e971e09f1 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:40.777387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:40.778060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:40.778378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:40.778659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:40.787018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:40.788782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:40.797070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1215/2440] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:49:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:49:47.883057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:47.884775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:47.898672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac8c2-8946-4f98-ad6a-faf04161c3b7 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:47.903100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:47.903949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:47.904227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:47.904499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] PATH_INFO: `/v3/users/59c0922d8e2f4389a3aa4b6daa9d3d37` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:47.905729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c0922d8e2f4389a3aa4b6daa9d3d37)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:47.907671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:47.951911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c0922d8e2f4389a3aa4b6daa9d3d37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:47.959224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c0922d8e2f4389a3aa4b6daa9d3d37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:47.959866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c0922d8e2f4389a3aa4b6daa9d3d37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:47.971279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c0922d8e2f4389a3aa4b6daa9d3d37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:47.971971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c0922d8e2f4389a3aa4b6daa9d3d37'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:47.984863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1226/2441] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:49:47 2022] DELETE /identity/v3/users/59c0922d8e2f4389a3aa4b6daa9d3d37 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:49:48.156897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:48.171960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c64b-a6a4-496b-803f-1b8e4d6a79ba service swift] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:48.229108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:48.229992 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:48.230279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:48.230555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] PATH_INFO: `/v3/projects/95636bf5a2284bc697044d2b3b46828a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:48.231738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95636bf5a2284bc697044d2b3b46828a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:48.233638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:48.279486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95636bf5a2284bc697044d2b3b46828a', 'request_id': 'req-6bd15416-3669-41c7-a7ac-2301bdeb0375'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.286104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95636bf5a2284bc697044d2b3b46828a', 'request_id': 'req-6bd15416-3669-41c7-a7ac-2301bdeb0375'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.292033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95636bf5a2284bc697044d2b3b46828a', 'request_id': 'req-6bd15416-3669-41c7-a7ac-2301bdeb0375'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.301722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] The token cache is being invalidate because project 95636bf5a2284bc697044d2b3b46828a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:49:48.302025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.302649 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.304166 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1216/2442] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:49:48 2022] DELETE /identity/v3/projects/95636bf5a2284bc697044d2b3b46828a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:49:48.308085 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:48.309525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:48.322766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453ed56-da74-43bf-b34f-b18a8c158aef admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:48.378673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:48.379476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:48.379757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:48.380033 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] PATH_INFO: `/v3/users/778a13a6cbca4628924594f5c5c94af7` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:48.381221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] RBAC: Authorizing `identity:delete_user(user_id=778a13a6cbca4628924594f5c5c94af7)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:48.383197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:48.427279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778a13a6cbca4628924594f5c5c94af7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.434482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778a13a6cbca4628924594f5c5c94af7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.435358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778a13a6cbca4628924594f5c5c94af7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.448282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778a13a6cbca4628924594f5c5c94af7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.448977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f543f928-a6fe-4a1d-a4b1-7a148c7c761a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778a13a6cbca4628924594f5c5c94af7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.462656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1227/2443] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:49:48 2022] DELETE /identity/v3/users/778a13a6cbca4628924594f5c5c94af7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:49:48.635308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:48.636846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:48.651532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15416-3669-41c7-a7ac-2301bdeb0375 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:48.712416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:48.713275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:48.713563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:48.713870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] PATH_INFO: `/v3/projects/18db6e6c7e4842cf83d8cf1a54e294d2` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:48.715061 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=18db6e6c7e4842cf83d8cf1a54e294d2)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:48.717039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:48.764461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18db6e6c7e4842cf83d8cf1a54e294d2', 'request_id': 'req-629528c7-245b-4c2a-afb8-66339dc122fb'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.772731 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18db6e6c7e4842cf83d8cf1a54e294d2', 'request_id': 'req-629528c7-245b-4c2a-afb8-66339dc122fb'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.779351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18db6e6c7e4842cf83d8cf1a54e294d2', 'request_id': 'req-629528c7-245b-4c2a-afb8-66339dc122fb'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.790033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] The token cache is being invalidate because project 18db6e6c7e4842cf83d8cf1a54e294d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:49:48.790315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.790939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-629528c7-245b-4c2a-afb8-66339dc122fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:49:48.792474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1217/2444] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:49:48 2022] DELETE /identity/v3/projects/18db6e6c7e4842cf83d8cf1a54e294d2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:49:48.799901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8a1d-26d8-48e2-9e9a-5716e0334385 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:48.800297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8a1d-26d8-48e2-9e9a-5716e0334385 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:48.800651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8a1d-26d8-48e2-9e9a-5716e0334385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:48.819666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-2deb8a1d-26d8-48e2-9e9a-5716e0334385 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:48.820872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-2deb8a1d-26d8-48e2-9e9a-5716e0334385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:48.893536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1228/2445] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:49:48.901309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af87c-966b-4688-85b6-c52471363d1d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:48.901591 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af87c-966b-4688-85b6-c52471363d1d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:48.901900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af87c-966b-4688-85b6-c52471363d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:48.921170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-f89af87c-966b-4688-85b6-c52471363d1d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:48.922430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f89af87c-966b-4688-85b6-c52471363d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:48.930399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1218/2446] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:49:48.934586 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb8a1d-26d8-48e2-9e9a-5716e0334385 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:48.944678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb8a1d-26d8-48e2-9e9a-5716e0334385 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:48.950002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:48.950651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:48.950931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:48.951205 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:48.951930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:49:48.952237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:48.954795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:48.966485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1229/2447] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:49:48.970953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af87c-966b-4688-85b6-c52471363d1d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:48.980520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af87c-966b-4688-85b6-c52471363d1d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:48.985565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:48.986193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:48.986469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:48.986738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:48.987453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:48.989351 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:49.018010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1219/2448] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:49:48 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:49:49.023916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:49.033727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39119452-9c37-466b-87ef-9632c8ae2be4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:49.090119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:49.090780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:49.091059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:49.091330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:49.092019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:49.093988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:49.114308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1230/2449] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:49:49 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:49:49.118184 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:49.129144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e97072-1527-471b-8abd-4b760daddb5c admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:49.133926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:49.134589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:49.134874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:49.135154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:49.135889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:49.138191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:49.151813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1220/2450] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:49:49.155911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:49.167229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e599-8cf0-49b6-9757-bd367f440ec6 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:49.173491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90a50-3f8b-45ba-b953-80b81ded47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:49.174194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90a50-3f8b-45ba-b953-80b81ded47d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:49.174483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90a50-3f8b-45ba-b953-80b81ded47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:49.174758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90a50-3f8b-45ba-b953-80b81ded47d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:49.175490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90a50-3f8b-45ba-b953-80b81ded47d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:49.177091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90a50-3f8b-45ba-b953-80b81ded47d9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:49.188285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1231/2451] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:49:49.192550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:49.203495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f305c-b77c-4a5c-9adf-a4a9c98e4178 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:49.210021 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:49.210973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:49.211257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:49.211535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] PATH_INFO: `/v3/projects/cde372d003ca4f5fbafa9d6a4bc52e3e/users/7f6da611aff04192a59cd39f3b2d6cb6/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:49.226264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde372d003ca4f5fbafa9d6a4bc52e3e, user_id=7f6da611aff04192a59cd39f3b2d6cb6, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:49.229036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:49.243880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1221/2452] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:49:49 2022] PUT /identity/v3/projects/cde372d003ca4f5fbafa9d6a4bc52e3e/users/7f6da611aff04192a59cd39f3b2d6cb6/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:49:49.248960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b22b-ffd3-4fe7-97d9-3df23c8b8591 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:49.249249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b22b-ffd3-4fe7-97d9-3df23c8b8591 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:49.251241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b22b-ffd3-4fe7-97d9-3df23c8b8591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:49.270743 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-ced3b22b-ffd3-4fe7-97d9-3df23c8b8591 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:49.272052 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ced3b22b-ffd3-4fe7-97d9-3df23c8b8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:49.331395 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1232/2453] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:49:49.340821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:49.342532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:49.398200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73628ba-a620-4c18-b2f9-a89bb0d6a591 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:49.401905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:49.402490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:49.402775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:49.403055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:49.411825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:49.413249 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:49.423109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1222/2454] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:49:53.545007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6dd55-bf4b-475f-8be6-be47beb31a44 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:53.545486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6dd55-bf4b-475f-8be6-be47beb31a44 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:53.545568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6dd55-bf4b-475f-8be6-be47beb31a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:53.574781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b0f6dd55-bf4b-475f-8be6-be47beb31a44 None None] MFA Rules not processed for user `7f6da611aff04192a59cd39f3b2d6cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:49:53.575924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b0f6dd55-bf4b-475f-8be6-be47beb31a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:53.653764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1233/2455] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:49:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:49:53.658087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:53.667821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba639-4ba2-499a-af4d-f9970a778f2a service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:53.673294 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:53.674087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:53.674442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:53.674793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:53.675568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:53.677655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:53.712601 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1223/2456] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:49:53 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:49:53.713764 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6dd55-bf4b-475f-8be6-be47beb31a44 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:53.725972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6dd55-bf4b-475f-8be6-be47beb31a44 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:53.801117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:53.801867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:53.802100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:53.802320 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:53.803189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:53.806188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:53.833214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1234/2457] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:49:53 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:49:53.836842 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:53.848727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfded7-d7f1-4c9f-a6a5-3cba26fbfcb3 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:53.853283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:53.853987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:53.854272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:53.854546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:53.855271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:53.856882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:53.868370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1224/2458] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:49:53.873156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:53.883628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e3bb8-6004-4bbe-a8ea-056a7e11f55d admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:53.888475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:53.889374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:53.889645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:53.890792 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] PATH_INFO: `/v3/projects/0530226851c04ebcb6760a2c1bfe606f/users/a76ee8849fb34c959a841cca0d863123/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:53.907625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0530226851c04ebcb6760a2c1bfe606f, user_id=a76ee8849fb34c959a841cca0d863123, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:53.912284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:53.926703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1235/2459] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:49:53 2022] PUT /identity/v3/projects/0530226851c04ebcb6760a2c1bfe606f/users/a76ee8849fb34c959a841cca0d863123/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:49:53.930902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:53.940951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a83cca-b6d4-44e1-a9fd-cd9618993284 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:54.003896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:54.004577 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:54.004860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:54.005137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:54.005905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:54.007556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:54.018782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1225/2460] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:49:54.022868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:54.034219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e26c-546c-4f01-8d92-e787bf9b4a4f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:54.039070 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:54.039976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:54.040324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:54.040666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] PATH_INFO: `/v3/projects/0530226851c04ebcb6760a2c1bfe606f/users/a76ee8849fb34c959a841cca0d863123/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:54.042763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0530226851c04ebcb6760a2c1bfe606f, user_id=a76ee8849fb34c959a841cca0d863123, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:54.045436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:54.056771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1236/2461] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:49:54 2022] PUT /identity/v3/projects/0530226851c04ebcb6760a2c1bfe606f/users/a76ee8849fb34c959a841cca0d863123/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:49:55.617489 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:55.619699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:55.700297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a60e-bac5-40d9-9188-932fb20cf595 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:55.753629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42495dfe-a39f-4c19-a7e6-54b4f6c57695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:55.754410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42495dfe-a39f-4c19-a7e6-54b4f6c57695 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:55.754698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42495dfe-a39f-4c19-a7e6-54b4f6c57695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:55.754972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42495dfe-a39f-4c19-a7e6-54b4f6c57695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:55.758115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-42495dfe-a39f-4c19-a7e6-54b4f6c57695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:55.857031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42495dfe-a39f-4c19-a7e6-54b4f6c57695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:55.861322 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42495dfe-a39f-4c19-a7e6-54b4f6c57695 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:55.883555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1226/2462] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:49:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:49:57.449117 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:49:57.464918 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53755-aebb-46ba-bab9-34ee612d21c0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:49:57.472827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:49:57.474561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:49:57.475525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:49:57.475974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:49:57.480382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:49:57.504288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:49:57.512181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:49:57.527523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1237/2463] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:49:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:00.907218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c986229-750c-4b14-b793-441db7b2d34c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:00.907684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c986229-750c-4b14-b793-441db7b2d34c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:00.907684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c986229-750c-4b14-b793-441db7b2d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:00.940725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7c986229-750c-4b14-b793-441db7b2d34c None None] MFA Rules not processed for user `a76ee8849fb34c959a841cca0d863123`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:00.942403 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7c986229-750c-4b14-b793-441db7b2d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:01.019289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1227/2464] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:01.034754 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:01.036228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:01.051478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce513b36-fd3c-40f1-9053-161495d3f0c8 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:01.059209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:01.060154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:01.060436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:01.060708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:01.119537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:01.120123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:01.129206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1238/2465] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:02.175047 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457d59-0072-4b16-94dd-844ddab8fa5b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:02.175578 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457d59-0072-4b16-94dd-844ddab8fa5b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:02.175673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457d59-0072-4b16-94dd-844ddab8fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:02.192778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-cf457d59-0072-4b16-94dd-844ddab8fa5b None None] MFA Rules not processed for user `7f6da611aff04192a59cd39f3b2d6cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:02.194042 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-cf457d59-0072-4b16-94dd-844ddab8fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:02.201023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1228/2466] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:11.494240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:11.495678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:11.510269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613ccd-75b5-4c85-96e4-7fd0ac9c48e5 service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:11.516160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:11.516901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:11.517183 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:11.517460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:11.519259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:11.578465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:11.580409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:11.589663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1239/2467] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:16.370002 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457d59-0072-4b16-94dd-844ddab8fa5b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:16.379371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457d59-0072-4b16-94dd-844ddab8fa5b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:16.382855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:16.383483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:16.383764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:16.384039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:16.385799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:16.469212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:16.471518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:16.481250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1229/2468] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:19.692699 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:19.694356 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:19.714109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db563-387c-4914-829d-b0ec600340b4 service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:19.718727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:19.719594 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:19.719870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:19.720141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] PATH_INFO: `/v3/users/af0e1282e6024c9c8f128a8d7b235733` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:19.721513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0e1282e6024c9c8f128a8d7b235733)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:19.723544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:19.770436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0e1282e6024c9c8f128a8d7b235733'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:19.778290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0e1282e6024c9c8f128a8d7b235733'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:19.779137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0e1282e6024c9c8f128a8d7b235733'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:19.791191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0e1282e6024c9c8f128a8d7b235733'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:19.791845 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-18676bbd-77aa-41cb-b5f2-2a77d744dca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0e1282e6024c9c8f128a8d7b235733'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:19.804436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1240/2469] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:50:19 2022] DELETE /identity/v3/users/af0e1282e6024c9c8f128a8d7b235733 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:19.979812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:19.998320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5165-f8d4-46ab-aea1-821e54711dc6 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.055034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.055879 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.056157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.056425 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] PATH_INFO: `/v3/projects/dd154e9ddff14089b8fc96ba030e5669` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.057575 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd154e9ddff14089b8fc96ba030e5669)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.059506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.102049 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd154e9ddff14089b8fc96ba030e5669', 'request_id': 'req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:20.108564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd154e9ddff14089b8fc96ba030e5669', 'request_id': 'req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:20.114946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd154e9ddff14089b8fc96ba030e5669', 'request_id': 'req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:20.124772 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] The token cache is being invalidate because project dd154e9ddff14089b8fc96ba030e5669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:50:20.125001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:20.125613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2fb24e3f-c3ed-4f02-9165-5b5a11977bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:20.127760 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1230/2470] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:50:19 2022] DELETE /identity/v3/projects/dd154e9ddff14089b8fc96ba030e5669 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:20.132718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e400b-aa33-4173-993a-7bbd6e607fe8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.133029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e400b-aa33-4173-993a-7bbd6e607fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.133310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e400b-aa33-4173-993a-7bbd6e607fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.150826 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7f5e400b-aa33-4173-993a-7bbd6e607fe8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:20.152034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7f5e400b-aa33-4173-993a-7bbd6e607fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:20.210009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1241/2471] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:20.217806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90950e-2f8a-4091-9257-c33d692abf1b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.218022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90950e-2f8a-4091-9257-c33d692abf1b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.218297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90950e-2f8a-4091-9257-c33d692abf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.235776 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ca90950e-2f8a-4091-9257-c33d692abf1b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:20.237483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ca90950e-2f8a-4091-9257-c33d692abf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:20.245170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1231/2472] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:20.249217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e400b-aa33-4173-993a-7bbd6e607fe8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.259091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e400b-aa33-4173-993a-7bbd6e607fe8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.263533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.264173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.264452 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.264725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.265440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:50:20.265768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.267398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.278408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1242/2473] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:50:20.282449 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90950e-2f8a-4091-9257-c33d692abf1b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.291219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90950e-2f8a-4091-9257-c33d692abf1b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.295797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.296421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.296699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.296968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.297640 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.300078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.324482 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1232/2474] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:50:20 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:50:20.328353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.338234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407640d9-5513-49b2-9db8-96d9fd22448d admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.391377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.391977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.392283 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.392556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.393233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.395184 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.415463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1243/2475] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:50:20 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:50:20.419617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.430415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3f971-e9a2-4de2-ab6d-ae5a7120b0f8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.435352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.436010 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.436287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.436562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.437287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.438909 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.452144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1233/2476] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:50:20.453337 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.463687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72cb8-9811-4255-95f1-681a1fe06605 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.468311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72659b-53ba-4da4-9282-38d5bfad2cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.468960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72659b-53ba-4da4-9282-38d5bfad2cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.469246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72659b-53ba-4da4-9282-38d5bfad2cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.469536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72659b-53ba-4da4-9282-38d5bfad2cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.470828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72659b-53ba-4da4-9282-38d5bfad2cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.472424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72659b-53ba-4da4-9282-38d5bfad2cd1 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.485422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1244/2477] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:50:20.487376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.497522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a3f74-42cd-41b0-b3a9-4eef6ae88f42 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.502515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.504006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.504006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.504193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] PATH_INFO: `/v3/projects/d31fcb040eb24a53937ddbcb46424ec1/users/8c130dd2e1e54097b4d713c13f635321/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.519423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31fcb040eb24a53937ddbcb46424ec1, user_id=8c130dd2e1e54097b4d713c13f635321, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.522142 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.535935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1234/2478] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:50:20 2022] PUT /identity/v3/projects/d31fcb040eb24a53937ddbcb46424ec1/users/8c130dd2e1e54097b4d713c13f635321/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:20.545617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4dd9d-93eb-4729-abfd-ea63f63ae5b5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.545950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4dd9d-93eb-4729-abfd-ea63f63ae5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.546228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4dd9d-93eb-4729-abfd-ea63f63ae5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.572765 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-dbc4dd9d-93eb-4729-abfd-ea63f63ae5b5 None None] MFA Rules not processed for user `8c130dd2e1e54097b4d713c13f635321`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:20.574012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-dbc4dd9d-93eb-4729-abfd-ea63f63ae5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:20.638135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1245/2479] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:20.642987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.703242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c16c2-e3dc-4339-8679-9cb9b99a91d2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.708651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.709304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.709586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.709892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.710580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.712483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.741303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1235/2480] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:50:20 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:50:20.742501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4dd9d-93eb-4729-abfd-ea63f63ae5b5 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.753238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4dd9d-93eb-4729-abfd-ea63f63ae5b5 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.790014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.791715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:20.810330 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.811006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.811295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.811575 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.812268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.814303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.834689 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1246/2481] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:50:20 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:50:20.838483 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.848347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb11fff-b635-4c60-a667-1534e508e763 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.848506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b08b6-6984-43e8-9c8b-79cb2c7237e4 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.852012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.852648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.852932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.853054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.853211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.853684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.854013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.854280 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.854994 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.855120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:20.856574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.864902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.866477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.866866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1247/2482] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:50:20.870719 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.878018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1236/2483] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:50:20.881863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6950d6-fc07-422d-b894-2f9b59cc23b2 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:20.886812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:20.887714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:20.887998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:20.888276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] PATH_INFO: `/v3/projects/272140b4e8fc47e8b7dd60098cc1edfb/users/a917eb404bc04840a5c32050e62b8fec/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:20.904415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=272140b4e8fc47e8b7dd60098cc1edfb, user_id=a917eb404bc04840a5c32050e62b8fec, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:20.908815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:20.923367 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1248/2484] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:50:20 2022] PUT /identity/v3/projects/272140b4e8fc47e8b7dd60098cc1edfb/users/a917eb404bc04840a5c32050e62b8fec/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:50:20.927407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:20.940504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93552f0-5306-47ce-938b-826dcf777a62 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:21.005506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a556d78-5460-4362-9ea4-2049db0598bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:21.006699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556d78-5460-4362-9ea4-2049db0598bf admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:21.007029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556d78-5460-4362-9ea4-2049db0598bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:21.007632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556d78-5460-4362-9ea4-2049db0598bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:21.008834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a556d78-5460-4362-9ea4-2049db0598bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:21.010993 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a556d78-5460-4362-9ea4-2049db0598bf admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:21.024984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1237/2485] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:50:21.026172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:21.039373 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01fa2-abf3-46e9-a386-bcdfd4a605ce admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:21.045216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:21.046857 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:21.047300 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:21.047730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] PATH_INFO: `/v3/projects/272140b4e8fc47e8b7dd60098cc1edfb/users/a917eb404bc04840a5c32050e62b8fec/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:21.050151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272140b4e8fc47e8b7dd60098cc1edfb, user_id=a917eb404bc04840a5c32050e62b8fec, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:21.053004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:21.066911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1249/2486] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:50:21 2022] PUT /identity/v3/projects/272140b4e8fc47e8b7dd60098cc1edfb/users/a917eb404bc04840a5c32050e62b8fec/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:21.079549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:21.080491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:21.080771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:21.114267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] MFA Rules not processed for user `a917eb404bc04840a5c32050e62b8fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:21.115636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:21.193568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1238/2487] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:21.204700 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:21.207108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:21.267079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4841a-0471-43a5-a383-eb01fba47686 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:21.271362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:21.272041 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:21.272335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:21.272595 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:21.284089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:21.285893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:21.296951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1250/2488] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:21.347338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:21.348969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:21.388741 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:21.401163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e0f3-4863-4ac6-ab1a-44ab19e94fc0 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:21.405487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:21.406214 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:21.406475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:21.406738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:21.432389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f405d2a-d9e4-498e-8b03-cf998d0c0532 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:21.437535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:21.438276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:21.438644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:21.439001 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:21.441453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:21.454456 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:21.456179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:21.463396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:21.464842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:21.466330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1239/2489] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:21.476455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1251/2490] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:50:23.249665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:23.251135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:23.316963 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c90017-6b1f-48e6-a27e-05b08cfdf0cd service placement] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:23.320687 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:23.321362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:23.321647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:23.321957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:23.323897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:23.336117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:23.337990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:23.347311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1240/2491] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:24.105107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:24.106559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:24.240423 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90959-3baf-4741-bcef-9fc19db07237 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:24.250754 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:24.251477 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:24.252406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:24.252865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:24.255128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:24.271044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:24.272803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:24.297044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1252/2492] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:25.109882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:25.111307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:25.179099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f31f-92fa-42a2-ab86-286cb7a9a90b service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:25.183600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:25.184460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:25.184744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:25.185018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] PATH_INFO: `/v3/users/70abbcb3651945609f0e65237135f3e7` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:25.186242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=70abbcb3651945609f0e65237135f3e7)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:25.188456 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:25.232387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70abbcb3651945609f0e65237135f3e7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.239528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70abbcb3651945609f0e65237135f3e7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.240183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70abbcb3651945609f0e65237135f3e7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.252393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70abbcb3651945609f0e65237135f3e7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.253028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70abbcb3651945609f0e65237135f3e7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.265208 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1241/2493] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:50:25 2022] DELETE /identity/v3/users/70abbcb3651945609f0e65237135f3e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:25.431371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:25.443802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca7bf0-abb6-4983-8558-e33d2ce79c98 service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:25.506463 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:25.507328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:25.507608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:25.507882 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] PATH_INFO: `/v3/projects/7a1abe690e43433daccff30391d4b260` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:25.509095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1abe690e43433daccff30391d4b260)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:25.511062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:25.557521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1abe690e43433daccff30391d4b260', 'request_id': 'req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.563911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1abe690e43433daccff30391d4b260', 'request_id': 'req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.570453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1abe690e43433daccff30391d4b260', 'request_id': 'req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.581228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] The token cache is being invalidate because project 7a1abe690e43433daccff30391d4b260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:50:25.581541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.582204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:25.583729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1253/2494] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:50:25 2022] DELETE /identity/v3/projects/7a1abe690e43433daccff30391d4b260 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:28.607694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:28.609155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:28.679173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33486a-5940-4364-ac41-d126edcf1baf admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:28.738922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7b6a-4b57-4bc5-9ed1-713eacb50498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:28.739563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7b6a-4b57-4bc5-9ed1-713eacb50498 service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:28.739848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7b6a-4b57-4bc5-9ed1-713eacb50498 service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:28.740121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7b6a-4b57-4bc5-9ed1-713eacb50498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:28.741916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-871a7b6a-4b57-4bc5-9ed1-713eacb50498 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:28.798271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7b6a-4b57-4bc5-9ed1-713eacb50498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:28.799857 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7b6a-4b57-4bc5-9ed1-713eacb50498 service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:28.808712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1242/2495] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:30.323172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:30.324567 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:30.386563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d314595-c14b-4a2b-93fd-d2b66cfbdb31 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:30.391134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:30.392001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:30.392875 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:30.393156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] PATH_INFO: `/v3/users/8c130dd2e1e54097b4d713c13f635321` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:30.394432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c130dd2e1e54097b4d713c13f635321)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:30.396380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:30.446898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c130dd2e1e54097b4d713c13f635321'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:30.455830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c130dd2e1e54097b4d713c13f635321'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:30.456448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c130dd2e1e54097b4d713c13f635321'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:30.475712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c130dd2e1e54097b4d713c13f635321'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:30.476362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c130dd2e1e54097b4d713c13f635321'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:30.489166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1254/2496] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:50:30 2022] DELETE /identity/v3/users/8c130dd2e1e54097b4d713c13f635321 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:50:30.493602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:30.494076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:30.494219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:30.511307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:30.512493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:30.568997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1243/2497] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:30.578664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:30.580362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:30.635134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768e6d7-85af-49a5-a2b5-68b01fe623c5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:30.638822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:30.639401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:30.639690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:30.639969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:30.648756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:30.650241 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:30.659407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1255/2498] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:30.971978 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:30.973467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:30.988602 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47415b-cebb-4648-9236-d1efd39e21e6 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:31.001096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:31.002028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.002311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.002584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] PATH_INFO: `/v3/projects/d31fcb040eb24a53937ddbcb46424ec1` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.003886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31fcb040eb24a53937ddbcb46424ec1)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:31.005821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:31.053970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31fcb040eb24a53937ddbcb46424ec1', 'request_id': 'req-963c4330-529c-40fd-974d-e97009f27a1d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.061192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31fcb040eb24a53937ddbcb46424ec1', 'request_id': 'req-963c4330-529c-40fd-974d-e97009f27a1d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.067821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31fcb040eb24a53937ddbcb46424ec1', 'request_id': 'req-963c4330-529c-40fd-974d-e97009f27a1d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.080107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] The token cache is being invalidate because project d31fcb040eb24a53937ddbcb46424ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:50:31.080402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.081090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.082917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1244/2499] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:50:30 2022] DELETE /identity/v3/projects/d31fcb040eb24a53937ddbcb46424ec1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:31.087059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:31.097060 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555017-58fc-4f9f-907c-8c3231fe6721 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:31.159698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:31.160585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.160878 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.161149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] PATH_INFO: `/v3/users/a917eb404bc04840a5c32050e62b8fec` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.162363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a917eb404bc04840a5c32050e62b8fec)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:31.164429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:31.210964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a917eb404bc04840a5c32050e62b8fec'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.218590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a917eb404bc04840a5c32050e62b8fec'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.219462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a917eb404bc04840a5c32050e62b8fec'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.232649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a917eb404bc04840a5c32050e62b8fec'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.233503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f13a0a4b-884e-4de8-84e5-b6ecaec2c079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a917eb404bc04840a5c32050e62b8fec'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.246746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1256/2500] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:50:31 2022] DELETE /identity/v3/users/a917eb404bc04840a5c32050e62b8fec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:31.532632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:31.534176 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:31.550997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c4330-529c-40fd-974d-e97009f27a1d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:31.609824 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:31.610685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.611022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.613414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] PATH_INFO: `/v3/projects/272140b4e8fc47e8b7dd60098cc1edfb` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.614638 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=272140b4e8fc47e8b7dd60098cc1edfb)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:31.616601 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:31.665279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272140b4e8fc47e8b7dd60098cc1edfb', 'request_id': 'req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.672923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272140b4e8fc47e8b7dd60098cc1edfb', 'request_id': 'req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.679871 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272140b4e8fc47e8b7dd60098cc1edfb', 'request_id': 'req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.690367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] The token cache is being invalidate because project 272140b4e8fc47e8b7dd60098cc1edfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:50:31.690661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.691335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c17c5bd6-9f87-4c3f-9834-98fa8a38adfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:50:31.693222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1245/2501] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:50:31 2022] DELETE /identity/v3/projects/272140b4e8fc47e8b7dd60098cc1edfb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:31.697863 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55a5e-6dce-4fa8-8e56-a45424201296 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.698343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55a5e-6dce-4fa8-8e56-a45424201296 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.698440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55a5e-6dce-4fa8-8e56-a45424201296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.716406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-43a55a5e-6dce-4fa8-8e56-a45424201296 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:31.717603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-43a55a5e-6dce-4fa8-8e56-a45424201296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:31.775751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1257/2502] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:31.784064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890be17-ad73-40c4-b788-e7d77afbbf33 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.784352 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890be17-ad73-40c4-b788-e7d77afbbf33 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.784633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890be17-ad73-40c4-b788-e7d77afbbf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.807147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9890be17-ad73-40c4-b788-e7d77afbbf33 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:31.808393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9890be17-ad73-40c4-b788-e7d77afbbf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:31.816671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1246/2503] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:31.820943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55a5e-6dce-4fa8-8e56-a45424201296 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:31.830776 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55a5e-6dce-4fa8-8e56-a45424201296 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:31.835274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:31.835950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.836229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.836504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.837223 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:50:31.837528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:31.839170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:31.850860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1258/2504] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:50:31.855033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890be17-ad73-40c4-b788-e7d77afbbf33 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:31.865338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890be17-ad73-40c4-b788-e7d77afbbf33 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:31.870136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:31.870764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.871040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.871311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.872003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:31.873934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:31.898059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1247/2505] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:50:31 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:50:31.902093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:31.912430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b83550-fe43-4a94-84b9-7bc0cdfc0bd5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:31.967009 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:31.967681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:31.967966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:31.968242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:31.968939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:31.971496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:31.991160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1259/2506] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:50:31 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:50:31.995481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.005723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe5d8-f712-460b-b635-084fa5b13d64 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.011245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.012460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.012460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.012958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.013528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.015155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.027101 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1248/2507] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:50:32.031095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.041628 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3790c-1199-4c6f-bada-d952d283f8e8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.046508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ec502-1792-4911-a50f-d83e1c5d44c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.047170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec502-1792-4911-a50f-d83e1c5d44c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.047453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec502-1792-4911-a50f-d83e1c5d44c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.047730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec502-1792-4911-a50f-d83e1c5d44c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.048481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ec502-1792-4911-a50f-d83e1c5d44c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.050190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ec502-1792-4911-a50f-d83e1c5d44c9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.060431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1260/2508] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:50:32.064552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.074279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035cefd-7eea-4311-b22b-2548ab740f64 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.078835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.080477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.080747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.081018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] PATH_INFO: `/v3/projects/bbaf31ce18ab4d2db61b6823c3380aa3/users/ff58af2acab44c62a7c99573e229c9ef/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.094939 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaf31ce18ab4d2db61b6823c3380aa3, user_id=ff58af2acab44c62a7c99573e229c9ef, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.098206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.110503 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1249/2509] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:50:32 2022] PUT /identity/v3/projects/bbaf31ce18ab4d2db61b6823c3380aa3/users/ff58af2acab44c62a7c99573e229c9ef/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:32.120793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9207-34d1-433d-a74b-c20959a7789d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.121299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9207-34d1-433d-a74b-c20959a7789d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.121631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9207-34d1-433d-a74b-c20959a7789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.152141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-053a9207-34d1-433d-a74b-c20959a7789d None None] MFA Rules not processed for user `ff58af2acab44c62a7c99573e229c9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:32.153354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-053a9207-34d1-433d-a74b-c20959a7789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:32.215660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1261/2510] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:32.220057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.278584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc5b8-0a01-4273-a881-59c6c50a849f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.283820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.284461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.284744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.285024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.285715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.287623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.312050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1250/2511] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:50:32 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:50:32.316455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9207-34d1-433d-a74b-c20959a7789d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.327252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9207-34d1-433d-a74b-c20959a7789d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.382548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.383224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.383511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.383790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.384479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.386456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.406729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1262/2512] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:50:32 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:50:32.410608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.421163 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ff2c9-7a50-43af-bf74-9bee0aa452b0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.426086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.426741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.427026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.427303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.428029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.429625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.440559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1251/2513] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:50:32.444605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.455664 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b498-b073-4bdd-9de8-348ec4b4f2ae admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.460335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.461215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.461502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.461814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] PATH_INFO: `/v3/projects/17c3edefa442456689d9e03662b1ffec/users/dcf1783087e54d22851565157b64b996/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.476178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c3edefa442456689d9e03662b1ffec, user_id=dcf1783087e54d22851565157b64b996, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.478833 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.491425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1263/2514] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:50:32 2022] PUT /identity/v3/projects/17c3edefa442456689d9e03662b1ffec/users/dcf1783087e54d22851565157b64b996/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:50:32.495275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.505662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdc31b-d8fc-4a77-ab23-3be913fbef1d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.560931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10422aff-a087-4ce9-9888-fb5b431309b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.561589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10422aff-a087-4ce9-9888-fb5b431309b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.561917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10422aff-a087-4ce9-9888-fb5b431309b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.562193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10422aff-a087-4ce9-9888-fb5b431309b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.562907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10422aff-a087-4ce9-9888-fb5b431309b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.565005 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10422aff-a087-4ce9-9888-fb5b431309b4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.574843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1252/2515] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:50:32.579035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.589925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bcefe-9c2f-4a0c-aca1-4c9a02ebf2e7 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.594467 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.595360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.595643 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.595916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] PATH_INFO: `/v3/projects/17c3edefa442456689d9e03662b1ffec/users/dcf1783087e54d22851565157b64b996/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.597906 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c3edefa442456689d9e03662b1ffec, user_id=dcf1783087e54d22851565157b64b996, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.600559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.610430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1264/2516] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:50:32 2022] PUT /identity/v3/projects/17c3edefa442456689d9e03662b1ffec/users/dcf1783087e54d22851565157b64b996/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:50:32.621329 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627bae-df82-4082-89ed-775f07d9b1b9 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.621618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627bae-df82-4082-89ed-775f07d9b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.621924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627bae-df82-4082-89ed-775f07d9b1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.648043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4a627bae-df82-4082-89ed-775f07d9b1b9 None None] MFA Rules not processed for user `dcf1783087e54d22851565157b64b996`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:32.649225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4a627bae-df82-4082-89ed-775f07d9b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:32.715777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1253/2517] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:32.729566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:32.732230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:32.790739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b369-2360-48cc-903a-bc7c1ba2efd8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:32.794607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e703725-c45a-475f-a79c-b831cea23f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:32.795633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703725-c45a-475f-a79c-b831cea23f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:32.796059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703725-c45a-475f-a79c-b831cea23f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:32.796493 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703725-c45a-475f-a79c-b831cea23f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:32.862118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e703725-c45a-475f-a79c-b831cea23f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:32.863662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e703725-c45a-475f-a79c-b831cea23f30 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:32.872847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1265/2518] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:37.471651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627bae-df82-4082-89ed-775f07d9b1b9 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:37.481807 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627bae-df82-4082-89ed-775f07d9b1b9 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:37.485312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:37.485983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:37.486259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:37.486530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:37.496129 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:37.497559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:37.507107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1254/2519] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:40.530956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:40.531470 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:40.531593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:40.550342 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] MFA Rules not processed for user `97227abbbafa46f1b0660e3be2ceea70`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:40.551583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:40.606877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1266/2520] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:50:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:41.125217 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:41.127421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:41.221155 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14c67a-5cb0-4bd2-9b8e-aa1f76f2a419 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:41.226746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630b018-a948-4144-8145-65258f6c26af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:41.227395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b018-a948-4144-8145-65258f6c26af service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:41.227701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b018-a948-4144-8145-65258f6c26af service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:41.228041 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b018-a948-4144-8145-65258f6c26af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:41.229865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c630b018-a948-4144-8145-65258f6c26af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:41.245542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630b018-a948-4144-8145-65258f6c26af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:41.247211 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630b018-a948-4144-8145-65258f6c26af service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:41.259305 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1255/2521] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:44.131534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:44.132937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:44.188585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35beccb3-a9e0-4643-aa38-b840366bd26a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:44.192691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:44.193331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:44.193617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:44.193924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:44.195693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:44.256224 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:44.257658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:44.267087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1267/2522] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:50:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:50:52.684604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ca8e-b3ee-4f16-8102-0c2c0345b59f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:52.685086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ca8e-b3ee-4f16-8102-0c2c0345b59f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:52.685086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ca8e-b3ee-4f16-8102-0c2c0345b59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:52.703467 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e856ca8e-b3ee-4f16-8102-0c2c0345b59f None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:50:52.704661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e856ca8e-b3ee-4f16-8102-0c2c0345b59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:52.762050 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1256/2523] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:50:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:50:52.807081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:50:52.808485 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:50:52.875633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5246617-deea-4c9f-b9e8-00d38ffbd978 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:50:52.881462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:50:52.882150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:50:52.882429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:50:52.882710 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:50:52.891422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:50:52.893801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:50:52.902074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1268/2524] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:50:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:51:01.881124 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856ca8e-b3ee-4f16-8102-0c2c0345b59f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:01.895679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856ca8e-b3ee-4f16-8102-0c2c0345b59f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:01.901920 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae74012-14ae-4165-9a05-65bc70ddcc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:01.902562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae74012-14ae-4165-9a05-65bc70ddcc4e service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:01.902845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae74012-14ae-4165-9a05-65bc70ddcc4e service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:01.903120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae74012-14ae-4165-9a05-65bc70ddcc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:01.904899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5ae74012-14ae-4165-9a05-65bc70ddcc4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:01.918038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae74012-14ae-4165-9a05-65bc70ddcc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:01.919619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae74012-14ae-4165-9a05-65bc70ddcc4e service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:01.930870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1257/2525] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:51:02.839604 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:02.918363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef5f9-b639-471e-b550-e66c1383a015 service swift] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:02.924128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:02.925654 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:02.926162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:02.926598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] PATH_INFO: `/v3/users/ff58af2acab44c62a7c99573e229c9ef` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:02.928272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff58af2acab44c62a7c99573e229c9ef)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:02.930853 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:02.988424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff58af2acab44c62a7c99573e229c9ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:02.996568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff58af2acab44c62a7c99573e229c9ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:02.997345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff58af2acab44c62a7c99573e229c9ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.010476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff58af2acab44c62a7c99573e229c9ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.011440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff58af2acab44c62a7c99573e229c9ef'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.025872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1269/2526] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:51:02 2022] DELETE /identity/v3/users/ff58af2acab44c62a7c99573e229c9ef => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:03.029869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:03.030363 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:03.030450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:03.049419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:03.050376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:03.112866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1258/2527] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:03.122471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:03.123880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:03.181075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3737e9-b29f-4cdd-aff7-01710efe981a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:03.184677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:03.185312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:03.185592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:03.185893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:03.194937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:03.196358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:03.205791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1270/2528] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:03.487159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:03.488659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:03.502341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa6407-fdf9-49b8-b933-9f73ff183912 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:03.507344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:03.509333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:03.509643 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:03.509949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] PATH_INFO: `/v3/projects/bbaf31ce18ab4d2db61b6823c3380aa3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:03.511229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbaf31ce18ab4d2db61b6823c3380aa3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:03.513107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:03.560386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbaf31ce18ab4d2db61b6823c3380aa3', 'request_id': 'req-7122b4df-a7be-4363-8c09-feb811bac80c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.566719 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbaf31ce18ab4d2db61b6823c3380aa3', 'request_id': 'req-7122b4df-a7be-4363-8c09-feb811bac80c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.572766 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbaf31ce18ab4d2db61b6823c3380aa3', 'request_id': 'req-7122b4df-a7be-4363-8c09-feb811bac80c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.583302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] The token cache is being invalidate because project bbaf31ce18ab4d2db61b6823c3380aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:51:03.583587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.584210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.585762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1259/2529] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:51:03 2022] DELETE /identity/v3/projects/bbaf31ce18ab4d2db61b6823c3380aa3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:03.589676 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:03.599639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94944f31-4478-4bd3-bb52-0b320e9c04c3 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:03.653868 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:03.654724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:03.655010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:03.655288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] PATH_INFO: `/v3/users/dcf1783087e54d22851565157b64b996` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:03.656523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf1783087e54d22851565157b64b996)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:03.659211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:03.702204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf1783087e54d22851565157b64b996'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.710076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf1783087e54d22851565157b64b996'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.710694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf1783087e54d22851565157b64b996'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.722688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf1783087e54d22851565157b64b996'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.723315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-314e72ef-42b6-4b78-8c0e-70d5e7bf776e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf1783087e54d22851565157b64b996'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:03.735015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1271/2530] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:51:03 2022] DELETE /identity/v3/users/dcf1783087e54d22851565157b64b996 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:04.002195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.003677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:04.020407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b4df-a7be-4363-8c09-feb811bac80c admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.074603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.075457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.075741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.076046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] PATH_INFO: `/v3/projects/17c3edefa442456689d9e03662b1ffec` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.077316 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c3edefa442456689d9e03662b1ffec)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.079199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.122876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c3edefa442456689d9e03662b1ffec', 'request_id': 'req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:04.130231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c3edefa442456689d9e03662b1ffec', 'request_id': 'req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:04.136263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c3edefa442456689d9e03662b1ffec', 'request_id': 'req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:04.146960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] The token cache is being invalidate because project 17c3edefa442456689d9e03662b1ffec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:51:04.147247 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:04.147872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-d605bdda-d03d-46e8-abd2-c8b4ce482e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:04.149381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1260/2531] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:51:04 2022] DELETE /identity/v3/projects/17c3edefa442456689d9e03662b1ffec => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:04.154382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6771f-fa8a-489f-be2b-e4a4bd444d9e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.154859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6771f-fa8a-489f-be2b-e4a4bd444d9e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.154956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6771f-fa8a-489f-be2b-e4a4bd444d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.172967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7bf6771f-fa8a-489f-be2b-e4a4bd444d9e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:04.174704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7bf6771f-fa8a-489f-be2b-e4a4bd444d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:04.230649 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1272/2532] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:04.238754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26a23-0505-4909-aea6-816d6d4cc848 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.239048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26a23-0505-4909-aea6-816d6d4cc848 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.239327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26a23-0505-4909-aea6-816d6d4cc848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.257401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-16b26a23-0505-4909-aea6-816d6d4cc848 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:04.258635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-16b26a23-0505-4909-aea6-816d6d4cc848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:04.266466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1261/2533] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:04.270475 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6771f-fa8a-489f-be2b-e4a4bd444d9e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.279840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6771f-fa8a-489f-be2b-e4a4bd444d9e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.284340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.284978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.285262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.285538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.286305 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:51:04.286611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.288228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.299837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1273/2534] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:51:04.303844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b26a23-0505-4909-aea6-816d6d4cc848 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.312829 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b26a23-0505-4909-aea6-816d6d4cc848 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.318060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.318702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.318988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.319267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.319952 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.321881 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.346698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1262/2535] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:51:04 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:04.350617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.360233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef3add-de12-4dc7-b9d8-7611ac9172b6 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.415292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.415964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.416282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.416556 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.417306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.419278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.440396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1274/2536] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:51:04 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:04.444423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.454880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1bcd-bb06-49e7-8220-1d6daf57a616 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.464889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.465545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.465872 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.466152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.466883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.468493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.479121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1263/2537] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:04.483189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.493564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1baac-192d-4e13-a1a1-4dcd9d6c77a0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.498459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9d7cd-d1f3-4769-a56e-a1a7846b2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.499191 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d7cd-d1f3-4769-a56e-a1a7846b2224 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.499550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d7cd-d1f3-4769-a56e-a1a7846b2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.499901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9d7cd-d1f3-4769-a56e-a1a7846b2224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.500724 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d7cd-d1f3-4769-a56e-a1a7846b2224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.503026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9d7cd-d1f3-4769-a56e-a1a7846b2224 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.514139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1275/2538] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:04.518228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.528227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa6b07-98dc-4cc0-8362-cf534e35126a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.533066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.533973 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.534256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.534533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] PATH_INFO: `/v3/projects/53e0d9d72e94424eb69b42f64065a9ae/users/f7c4d2a25d0b49ceacdd5ff214f70b7b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.549596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e0d9d72e94424eb69b42f64065a9ae, user_id=f7c4d2a25d0b49ceacdd5ff214f70b7b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.552484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.566674 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1264/2539] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:51:04 2022] PUT /identity/v3/projects/53e0d9d72e94424eb69b42f64065a9ae/users/f7c4d2a25d0b49ceacdd5ff214f70b7b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:04.578007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615389f9-b9b6-4152-8c3c-00fa456d8d7d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.578303 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615389f9-b9b6-4152-8c3c-00fa456d8d7d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.578581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615389f9-b9b6-4152-8c3c-00fa456d8d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.604761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-615389f9-b9b6-4152-8c3c-00fa456d8d7d None None] MFA Rules not processed for user `f7c4d2a25d0b49ceacdd5ff214f70b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:04.605958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-615389f9-b9b6-4152-8c3c-00fa456d8d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:04.667426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1276/2540] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:04.671845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.730204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5c6cf-d888-4ed3-b4ac-9fd3faff9e90 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.734732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.735367 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.735645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.735910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.737206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.739116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.763168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1265/2541] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:51:04 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:04.767155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615389f9-b9b6-4152-8c3c-00fa456d8d7d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.778045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615389f9-b9b6-4152-8c3c-00fa456d8d7d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.831793 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.832448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.832730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.833012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.834327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.836338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.856133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1277/2542] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:51:04 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:51:04.860113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.871584 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306aa8-bf6a-4675-941a-a0c427a18ea8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.876107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.876748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.877281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.877563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.878325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.879906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.890438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1266/2543] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:04.894409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.904090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e30c1-6f8a-49df-8556-b6077998b459 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:04.909139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:04.910072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:04.910351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:04.910623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] PATH_INFO: `/v3/projects/d13db605f6bb4b898bdc19447783b0e3/users/6c10e2847b3949b9aa0e22498cea6758/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:04.925787 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13db605f6bb4b898bdc19447783b0e3, user_id=6c10e2847b3949b9aa0e22498cea6758, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:04.928524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:04.941678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1278/2544] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:51:04 2022] PUT /identity/v3/projects/d13db605f6bb4b898bdc19447783b0e3/users/6c10e2847b3949b9aa0e22498cea6758/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:04.946359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:04.958025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a2ed-f3f2-4289-ad84-4f67595ad547 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:05.023416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a81845-4de8-4fff-9135-3ab3873dab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:05.024103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81845-4de8-4fff-9135-3ab3873dab6f admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:05.024370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81845-4de8-4fff-9135-3ab3873dab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:05.024652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81845-4de8-4fff-9135-3ab3873dab6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:05.025377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a81845-4de8-4fff-9135-3ab3873dab6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:05.027021 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a81845-4de8-4fff-9135-3ab3873dab6f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:05.037987 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1267/2545] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:05.042045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:05.052296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85774-bbf1-4d19-a790-e0ec290d3b51 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:05.057075 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:05.057988 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:05.058271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:05.058544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] PATH_INFO: `/v3/projects/d13db605f6bb4b898bdc19447783b0e3/users/6c10e2847b3949b9aa0e22498cea6758/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:05.060971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13db605f6bb4b898bdc19447783b0e3, user_id=6c10e2847b3949b9aa0e22498cea6758, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:05.063755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:05.076642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1279/2546] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:51:05 2022] PUT /identity/v3/projects/d13db605f6bb4b898bdc19447783b0e3/users/6c10e2847b3949b9aa0e22498cea6758/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:05.087477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378862-231f-4cd8-a7dd-68c065974f82 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:05.087971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378862-231f-4cd8-a7dd-68c065974f82 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:05.088264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378862-231f-4cd8-a7dd-68c065974f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:05.114095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-45378862-231f-4cd8-a7dd-68c065974f82 None None] MFA Rules not processed for user `6c10e2847b3949b9aa0e22498cea6758`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:05.115207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-45378862-231f-4cd8-a7dd-68c065974f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:05.179945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1268/2547] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:05.190521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:05.192259 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:05.248306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7393b1-a6fb-4f99-b8b4-74c2e9cc7e26 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:05.252278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd95426-6f2b-4cdc-b763-c951cccac6ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:05.252914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95426-6f2b-4cdc-b763-c951cccac6ad service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:05.253200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95426-6f2b-4cdc-b763-c951cccac6ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:05.253478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95426-6f2b-4cdc-b763-c951cccac6ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:05.262386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd95426-6f2b-4cdc-b763-c951cccac6ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:05.263880 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd95426-6f2b-4cdc-b763-c951cccac6ad service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:05.273691 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1280/2548] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:05.397861 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378862-231f-4cd8-a7dd-68c065974f82 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:05.464428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378862-231f-4cd8-a7dd-68c065974f82 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:05.468935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:05.469854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:05.470138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:05.470956 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] PATH_INFO: `/v3/users/f7c4d2a25d0b49ceacdd5ff214f70b7b` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:05.472150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c4d2a25d0b49ceacdd5ff214f70b7b)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:05.474132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:05.522762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c4d2a25d0b49ceacdd5ff214f70b7b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:05.529334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c4d2a25d0b49ceacdd5ff214f70b7b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:05.530030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c4d2a25d0b49ceacdd5ff214f70b7b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:05.541520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c4d2a25d0b49ceacdd5ff214f70b7b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:05.542168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c4d2a25d0b49ceacdd5ff214f70b7b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:05.555498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1269/2549] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:51:05 2022] DELETE /identity/v3/users/f7c4d2a25d0b49ceacdd5ff214f70b7b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:05.559978 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:05.560265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:05.560538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:05.577473 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:05.578686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:05.638677 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1281/2550] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:05.659701 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:05.661109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:05.718026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef301ab-c902-4a73-8c1d-65b81c8d13ab admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:05.722718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:05.723512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:05.723863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:05.724145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:05.733490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:05.734964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:05.744375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1270/2551] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:06.018986 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:06.021102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:06.037400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019d4ec-a130-4905-b49e-585722abf80d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:06.047666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:06.048572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:06.048839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:06.049119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] PATH_INFO: `/v3/projects/53e0d9d72e94424eb69b42f64065a9ae` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:06.050383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e0d9d72e94424eb69b42f64065a9ae)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:06.052361 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:06.101086 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e0d9d72e94424eb69b42f64065a9ae', 'request_id': 'req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.108694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e0d9d72e94424eb69b42f64065a9ae', 'request_id': 'req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.114898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e0d9d72e94424eb69b42f64065a9ae', 'request_id': 'req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.124822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] The token cache is being invalidate because project 53e0d9d72e94424eb69b42f64065a9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:51:06.125105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.125782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.127925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1282/2552] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:51:06 2022] DELETE /identity/v3/projects/53e0d9d72e94424eb69b42f64065a9ae => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:06.131869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:06.141179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ab779-bce0-49c4-87a8-c6764cf6fa82 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:06.196619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:06.197485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:06.197798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:06.198081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] PATH_INFO: `/v3/users/6c10e2847b3949b9aa0e22498cea6758` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:06.199559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c10e2847b3949b9aa0e22498cea6758)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:06.201513 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:06.247756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c10e2847b3949b9aa0e22498cea6758'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.254883 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c10e2847b3949b9aa0e22498cea6758'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.255545 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c10e2847b3949b9aa0e22498cea6758'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.268209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c10e2847b3949b9aa0e22498cea6758'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.268887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-1626f8e8-372c-4bd3-8ddd-6a8c98ae3eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c10e2847b3949b9aa0e22498cea6758'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.282181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1271/2553] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:51:06 2022] DELETE /identity/v3/users/6c10e2847b3949b9aa0e22498cea6758 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:06.582620 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:06.584519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:06.606438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252ebef-a214-42c1-9e8b-f7c4e93e3b56 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:06.681225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:06.681840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:06.682003 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:06.682278 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] PATH_INFO: `/v3/projects/d13db605f6bb4b898bdc19447783b0e3` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:06.683486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13db605f6bb4b898bdc19447783b0e3)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:06.685472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:06.742876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13db605f6bb4b898bdc19447783b0e3', 'request_id': 'req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.751110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13db605f6bb4b898bdc19447783b0e3', 'request_id': 'req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.758062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13db605f6bb4b898bdc19447783b0e3', 'request_id': 'req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.770498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] The token cache is being invalidate because project d13db605f6bb4b898bdc19447783b0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:51:06.770789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.771573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ccf375e0-5fe0-4077-b4a2-0981183a5ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:06.773102 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1283/2554] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:51:06 2022] DELETE /identity/v3/projects/d13db605f6bb4b898bdc19447783b0e3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:06.778259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b1ba-6979-49a4-9bae-a911e00fe669 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:06.778628 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b1ba-6979-49a4-9bae-a911e00fe669 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:06.778972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b1ba-6979-49a4-9bae-a911e00fe669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:06.799168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6e18b1ba-6979-49a4-9bae-a911e00fe669 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:06.800552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6e18b1ba-6979-49a4-9bae-a911e00fe669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:06.860555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1272/2555] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:51:06.868465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4bd0-514c-4c57-b941-6358db1b17bc None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:06.868758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4bd0-514c-4c57-b941-6358db1b17bc None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:06.869051 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4bd0-514c-4c57-b941-6358db1b17bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:06.890286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a21e4bd0-514c-4c57-b941-6358db1b17bc None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:06.891543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a21e4bd0-514c-4c57-b941-6358db1b17bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:06.900435 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1284/2556] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:06.904630 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b1ba-6979-49a4-9bae-a911e00fe669 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:06.914085 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b1ba-6979-49a4-9bae-a911e00fe669 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:06.918777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:06.919428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:06.919712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:06.919991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:06.921605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:51:06.921980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:06.923650 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:06.939727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1273/2557] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:51:06.940767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e4bd0-514c-4c57-b941-6358db1b17bc None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:06.949864 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e4bd0-514c-4c57-b941-6358db1b17bc None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:06.958623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:06.959650 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:06.960112 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:06.960995 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:06.961730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:06.963630 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:06.989756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1285/2558] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:51:06 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:06.995889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:07.006364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafe0da-7cd1-4965-a26f-cd61acf9d001 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:07.071855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:07.072559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.072845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.073127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.073870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:07.075803 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:07.097327 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1274/2559] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:51:06 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:51:07.101270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:07.112867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714a10-8090-4d80-bc7d-878d03239bdc admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:07.117693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:07.118378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.118660 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.118933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.119670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:07.121275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:07.132276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1286/2560] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:07.136290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:07.147163 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bccad-db8a-4726-9249-1a56272488b1 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:07.151784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9de3d0-0fb6-48a4-87c4-adb67ee2eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:07.152441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de3d0-0fb6-48a4-87c4-adb67ee2eb8e admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.152725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de3d0-0fb6-48a4-87c4-adb67ee2eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.153000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de3d0-0fb6-48a4-87c4-adb67ee2eb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.153737 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9de3d0-0fb6-48a4-87c4-adb67ee2eb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:07.155698 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9de3d0-0fb6-48a4-87c4-adb67ee2eb8e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:07.165512 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1275/2561] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:51:07.169991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:07.180682 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8a6f-f954-46e4-9828-32a40275ced8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:07.185288 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:07.186198 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.186481 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.186759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] PATH_INFO: `/v3/projects/6b0111411d4f49e592c2a75b536ddb59/users/324d6c1ccfb44afdaa9dc158c315ca64/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.201588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0111411d4f49e592c2a75b536ddb59, user_id=324d6c1ccfb44afdaa9dc158c315ca64, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:07.204290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:07.217426 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1287/2562] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:51:07 2022] PUT /identity/v3/projects/6b0111411d4f49e592c2a75b536ddb59/users/324d6c1ccfb44afdaa9dc158c315ca64/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:07.227527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25186043-6c6a-44e6-bb15-2074a35470a4 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.227825 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25186043-6c6a-44e6-bb15-2074a35470a4 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.228103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25186043-6c6a-44e6-bb15-2074a35470a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.255077 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-25186043-6c6a-44e6-bb15-2074a35470a4 None None] MFA Rules not processed for user `324d6c1ccfb44afdaa9dc158c315ca64`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:07.256295 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-25186043-6c6a-44e6-bb15-2074a35470a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:07.319283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1276/2563] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:07.331607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:07.333405 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:07.400496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb8c6-7639-4561-b848-1f5fcb9fa0b5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:07.404149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27627721-b348-418e-a2ae-7d9cb16c903a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:07.404794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627721-b348-418e-a2ae-7d9cb16c903a service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.405078 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627721-b348-418e-a2ae-7d9cb16c903a service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.405354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627721-b348-418e-a2ae-7d9cb16c903a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.414093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27627721-b348-418e-a2ae-7d9cb16c903a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:07.415534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27627721-b348-418e-a2ae-7d9cb16c903a service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:07.424150 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1288/2564] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:51:07.443230 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25186043-6c6a-44e6-bb15-2074a35470a4 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:07.503540 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25186043-6c6a-44e6-bb15-2074a35470a4 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:07.508138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:07.508995 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.509279 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.509552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] PATH_INFO: `/v3/users/324d6c1ccfb44afdaa9dc158c315ca64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.510779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=324d6c1ccfb44afdaa9dc158c315ca64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:07.512686 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:07.557493 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324d6c1ccfb44afdaa9dc158c315ca64'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:07.564800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324d6c1ccfb44afdaa9dc158c315ca64'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:07.565480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324d6c1ccfb44afdaa9dc158c315ca64'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:07.576653 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324d6c1ccfb44afdaa9dc158c315ca64'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:07.577284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324d6c1ccfb44afdaa9dc158c315ca64'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:07.589374 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1277/2565] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:51:07 2022] DELETE /identity/v3/users/324d6c1ccfb44afdaa9dc158c315ca64 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:07.593913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.594406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.594510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.612838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:07.614077 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:07.680261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1289/2566] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:07.690632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:07.692019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:07.748216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519161b-0da8-4d53-a5e5-fc121352f0bd admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:07.752470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444852e3-e014-4f70-8c8a-926f1b614532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:07.753107 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444852e3-e014-4f70-8c8a-926f1b614532 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:07.753388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444852e3-e014-4f70-8c8a-926f1b614532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:07.753662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444852e3-e014-4f70-8c8a-926f1b614532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:07.762541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444852e3-e014-4f70-8c8a-926f1b614532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:07.763967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444852e3-e014-4f70-8c8a-926f1b614532 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:07.774232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1278/2567] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:08.055372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.058703 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:08.076731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f622d6-c1ab-45ab-a77e-e290e2fa0c0d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.083215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.084942 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.085307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.085585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] PATH_INFO: `/v3/projects/6b0111411d4f49e592c2a75b536ddb59` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.087417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0111411d4f49e592c2a75b536ddb59)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.089583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.136740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0111411d4f49e592c2a75b536ddb59', 'request_id': 'req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.144421 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0111411d4f49e592c2a75b536ddb59', 'request_id': 'req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.150872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0111411d4f49e592c2a75b536ddb59', 'request_id': 'req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.162130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] The token cache is being invalidate because project 6b0111411d4f49e592c2a75b536ddb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:51:08.162424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.163121 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-aa8c6e41-a15f-4d6a-8a4d-c017269e4632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.164684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1290/2568] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:51:08 2022] DELETE /identity/v3/projects/6b0111411d4f49e592c2a75b536ddb59 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:08.169725 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605264-2b7a-4c19-b349-15d028b49d5e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.170192 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605264-2b7a-4c19-b349-15d028b49d5e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.170474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605264-2b7a-4c19-b349-15d028b49d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.188134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0d605264-2b7a-4c19-b349-15d028b49d5e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:08.189948 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0d605264-2b7a-4c19-b349-15d028b49d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:08.249189 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1279/2569] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:08.257725 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a2ab-521c-4855-acf2-6148534a1314 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.258028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a2ab-521c-4855-acf2-6148534a1314 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.258310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a2ab-521c-4855-acf2-6148534a1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.276813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-fb96a2ab-521c-4855-acf2-6148534a1314 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:08.278042 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fb96a2ab-521c-4855-acf2-6148534a1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:08.286029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1291/2570] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:08.290392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d605264-2b7a-4c19-b349-15d028b49d5e None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.300478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d605264-2b7a-4c19-b349-15d028b49d5e None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.305075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.305750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.306046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.306311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.307036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:51:08.307341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.308942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.324198 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1280/2571] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 11:51:08.325392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96a2ab-521c-4855-acf2-6148534a1314 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.335045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96a2ab-521c-4855-acf2-6148534a1314 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.340158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.340807 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.341093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.341371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.342092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.344017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.382711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1292/2572] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:51:08 2022] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:08.383944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.393810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a075-499d-4df7-ae1c-f900cb211e23 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.449300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.450036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.450321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.450598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.451288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.453203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.478241 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1281/2573] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:51:08 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:08.479958 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.491204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82c191-86cf-4fb2-8f27-5882fb18c848 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.495946 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.501027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.501027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.501027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.501027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.501027 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.511866 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1293/2574] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:08.515534 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.525899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c51ca4-5678-4277-8a03-ef5cac5e67bf admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.530617 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449679b-8f12-4082-a14b-67ff9c98238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.531265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449679b-8f12-4082-a14b-67ff9c98238e admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.531552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449679b-8f12-4082-a14b-67ff9c98238e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.531830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449679b-8f12-4082-a14b-67ff9c98238e admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.532552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449679b-8f12-4082-a14b-67ff9c98238e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.534682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449679b-8f12-4082-a14b-67ff9c98238e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.544419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1282/2575] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:08.548701 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.559264 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57841ae7-cb99-4d1a-98c5-9f5e92205579 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.563908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a18f-e629-41e0-a9a6-6423f069d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.564815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a18f-e629-41e0-a9a6-6423f069d699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.565103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a18f-e629-41e0-a9a6-6423f069d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.565382 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a18f-e629-41e0-a9a6-6423f069d699 admin admin] PATH_INFO: `/v3/projects/03054d2522ed4f4fb3a2433974affdb7/users/ffb04409d01e4c83b583a08e868ba084/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.579928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a18f-e629-41e0-a9a6-6423f069d699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03054d2522ed4f4fb3a2433974affdb7, user_id=ffb04409d01e4c83b583a08e868ba084, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.582940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a18f-e629-41e0-a9a6-6423f069d699 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.595255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1294/2576] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:51:08 2022] PUT /identity/v3/projects/03054d2522ed4f4fb3a2433974affdb7/users/ffb04409d01e4c83b583a08e868ba084/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:51:08.606900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.607185 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.607458 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.634506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] MFA Rules not processed for user `ffb04409d01e4c83b583a08e868ba084`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:08.635723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:08.676843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.677336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.677636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.695032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:08.696262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:08.701614 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1283/2577] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:08.733715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.735091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:08.752017 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1295/2578] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 12 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:51:08.764167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.765684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:08.790362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59a7a-8ebd-4f1e-908a-87eae421f2a3 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.793966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.794599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.794874 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.795140 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.803273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.804710 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.813486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1284/2579] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:51:08.828240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:08.835114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5fa71-4170-46e0-8485-1840178a9df9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.840181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa213f2a-87c7-4b1a-a5cc-c8a19b9ff168 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.840827 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213f2a-87c7-4b1a-a5cc-c8a19b9ff168 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.841113 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213f2a-87c7-4b1a-a5cc-c8a19b9ff168 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.841388 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213f2a-87c7-4b1a-a5cc-c8a19b9ff168 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.850119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa213f2a-87c7-4b1a-a5cc-c8a19b9ff168 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.851784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa213f2a-87c7-4b1a-a5cc-c8a19b9ff168 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.859726 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1296/2580] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 11:51:08.898564 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7424c-615d-4f19-9609-e566723bcdaf service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:08.903876 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:08.904748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:08.905025 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:08.905295 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] PATH_INFO: `/v3/users/ffb04409d01e4c83b583a08e868ba084` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:08.906589 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb04409d01e4c83b583a08e868ba084)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:08.909164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:08.963146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb04409d01e4c83b583a08e868ba084'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.975330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb04409d01e4c83b583a08e868ba084'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.976084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb04409d01e4c83b583a08e868ba084'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.989120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb04409d01e4c83b583a08e868ba084'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:08.989864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb04409d01e4c83b583a08e868ba084'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:09.010671 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1285/2581] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:51:08 2022] DELETE /identity/v3/users/ffb04409d01e4c83b583a08e868ba084 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:51:09.015723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:09.016227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:09.016641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:09.045253 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:09.047362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:09.164987 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1297/2582] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:09.174566 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:09.176136 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:09.242200 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c7976-b961-4820-9156-2630d15341fe admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:09.248488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d0f0a-b8b8-415f-b0ec-cff91d39594c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:09.249331 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0f0a-b8b8-415f-b0ec-cff91d39594c service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:09.251645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0f0a-b8b8-415f-b0ec-cff91d39594c service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:09.252816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0f0a-b8b8-415f-b0ec-cff91d39594c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:09.271723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d0f0a-b8b8-415f-b0ec-cff91d39594c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:09.273180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d0f0a-b8b8-415f-b0ec-cff91d39594c service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:09.302971 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1286/2583] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:09.615708 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:09.617255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:09.630247 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5bd12-d871-4ca3-b8a0-57f67f9c0469 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:09.635334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:09.636210 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:09.636496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:09.636781 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] PATH_INFO: `/v3/projects/03054d2522ed4f4fb3a2433974affdb7` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:09.638031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03054d2522ed4f4fb3a2433974affdb7)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:09.639971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:09.704671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03054d2522ed4f4fb3a2433974affdb7', 'request_id': 'req-6bb956b3-424e-4998-8f4c-84e0eb8cc400'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:09.715155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03054d2522ed4f4fb3a2433974affdb7', 'request_id': 'req-6bb956b3-424e-4998-8f4c-84e0eb8cc400'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:09.722440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03054d2522ed4f4fb3a2433974affdb7', 'request_id': 'req-6bb956b3-424e-4998-8f4c-84e0eb8cc400'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:09.732947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] The token cache is being invalidate because project 03054d2522ed4f4fb3a2433974affdb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:51:09.733232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:09.733910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-6bb956b3-424e-4998-8f4c-84e0eb8cc400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:09.735492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1298/2584] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:51:09 2022] DELETE /identity/v3/projects/03054d2522ed4f4fb3a2433974affdb7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:09.740299 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce95ec8-5a57-4bf2-9d16-997845a75b45 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:09.740606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce95ec8-5a57-4bf2-9d16-997845a75b45 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:09.740875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce95ec8-5a57-4bf2-9d16-997845a75b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:09.768484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-dce95ec8-5a57-4bf2-9d16-997845a75b45 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:09.769692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-dce95ec8-5a57-4bf2-9d16-997845a75b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:09.832882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1287/2585] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:09.840550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bee36-545a-49db-b837-41db6f134880 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:09.840841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bee36-545a-49db-b837-41db6f134880 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:09.841118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bee36-545a-49db-b837-41db6f134880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:09.859799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-fc0bee36-545a-49db-b837-41db6f134880 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:09.861379 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fc0bee36-545a-49db-b837-41db6f134880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:09.869459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1299/2586] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:09.874178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce95ec8-5a57-4bf2-9d16-997845a75b45 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:09.885854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce95ec8-5a57-4bf2-9d16-997845a75b45 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:09.890853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:09.891618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:09.891966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:09.892312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:09.893718 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:51:09.894114 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:09.895783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:09.908160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1288/2587] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:51:09.912812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bee36-545a-49db-b837-41db6f134880 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:09.922580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bee36-545a-49db-b837-41db6f134880 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:09.927371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:09.928034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:09.928317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:09.928593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:09.929430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:09.943860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:09.978511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1300/2588] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:51:09 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:09.979734 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:09.990896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182e9d8-ad5d-4225-afab-2c83e1ca54af admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:10.057251 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:10.058069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:10.058432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:10.058771 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:10.059533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:10.061583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:10.085289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1289/2589] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:51:09 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:10.086357 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:10.097338 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a642dfa-9475-449e-bed0-ea472e1a5199 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:10.102531 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:10.103207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:10.103539 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:10.103912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:10.104641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:10.106294 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:10.117780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1301/2590] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:10.121968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:10.132371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a291c86-8106-4423-9832-c38fb4428e05 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:10.137751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4a923-6e2c-4262-9cd0-e53dbefdacb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:10.138488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4a923-6e2c-4262-9cd0-e53dbefdacb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:10.138781 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4a923-6e2c-4262-9cd0-e53dbefdacb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:10.139697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4a923-6e2c-4262-9cd0-e53dbefdacb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:10.140432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4a923-6e2c-4262-9cd0-e53dbefdacb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:10.142069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4a923-6e2c-4262-9cd0-e53dbefdacb6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:10.152832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1290/2591] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:10.157229 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:10.168412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a17a44-5ba5-4e10-9021-2856e727b37f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:10.173163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:10.174615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:10.174914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:10.175185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] PATH_INFO: `/v3/projects/a97795c4869e4c81bddfd34d9826b500/users/9a6a91f56c7f40948a24c0f79753f890/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:10.191101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97795c4869e4c81bddfd34d9826b500, user_id=9a6a91f56c7f40948a24c0f79753f890, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:10.193844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:10.218832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1302/2592] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:51:10 2022] PUT /identity/v3/projects/a97795c4869e4c81bddfd34d9826b500/users/9a6a91f56c7f40948a24c0f79753f890/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:10.225033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f3b3-1973-4652-941c-de78955cdd6e None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:10.225596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f3b3-1973-4652-941c-de78955cdd6e None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:10.225596 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f3b3-1973-4652-941c-de78955cdd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:10.255243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-2724f3b3-1973-4652-941c-de78955cdd6e None None] MFA Rules not processed for user `9a6a91f56c7f40948a24c0f79753f890`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:10.256756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2724f3b3-1973-4652-941c-de78955cdd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:10.350419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1291/2593] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:10.362945 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:10.370064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:10.463970 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0ba09-8118-40c0-a854-7ef9774725c8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:10.468291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:10.469284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:10.469750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:10.470208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:10.497498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:10.499315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:10.509293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1303/2594] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:28.385598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1f065-4e27-40af-b512-82c205d02eac None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:28.386178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1f065-4e27-40af-b512-82c205d02eac None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:28.386370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1f065-4e27-40af-b512-82c205d02eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:28.405064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-ffb1f065-4e27-40af-b512-82c205d02eac None None] MFA Rules not processed for user `7f0ef19cf7fb4fb2992d5b040fe80190`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:28.406269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ffb1f065-4e27-40af-b512-82c205d02eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:28.461062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1292/2595] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 12 11:51:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:28.473260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:28.474644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:28.539981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810dee-3b56-4f00-9a8c-fc0062aa6ca6 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:28.545040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a162607-94cc-4041-8461-fad8245c6943 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6754ef93d9344beeae2a5f2812746025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:28.545744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a162607-94cc-4041-8461-fad8245c6943 service swift] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:28.546034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a162607-94cc-4041-8461-fad8245c6943 service swift] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:28.546314 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a162607-94cc-4041-8461-fad8245c6943 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:28.554325 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a162607-94cc-4041-8461-fad8245c6943 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:28.555899 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a162607-94cc-4041-8461-fad8245c6943 service swift] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:28.563796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1304/2596] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 12 11:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 11:51:30.122626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1f065-4e27-40af-b512-82c205d02eac None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:30.181981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1f065-4e27-40af-b512-82c205d02eac None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:30.186481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:30.187336 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.187615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.187890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] PATH_INFO: `/v3/users/9a6a91f56c7f40948a24c0f79753f890` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.189068 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6a91f56c7f40948a24c0f79753f890)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:30.191026 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:30.234644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6a91f56c7f40948a24c0f79753f890'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.241810 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6a91f56c7f40948a24c0f79753f890'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.242480 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6a91f56c7f40948a24c0f79753f890'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.253790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6a91f56c7f40948a24c0f79753f890'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.254423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6a91f56c7f40948a24c0f79753f890'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.266655 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1293/2597] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:51:30 2022] DELETE /identity/v3/users/9a6a91f56c7f40948a24c0f79753f890 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:30.271109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.271588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.271711 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.289166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:30.290544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:30.346605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1305/2598] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:30.356827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:30.358234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:30.413354 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a361f-232c-4aee-91b4-0b720c040cf9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:30.417086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a6330-893d-4150-9f36-10a15792a032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:30.417751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a6330-893d-4150-9f36-10a15792a032 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.418043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a6330-893d-4150-9f36-10a15792a032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.418321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a6330-893d-4150-9f36-10a15792a032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.427484 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a6330-893d-4150-9f36-10a15792a032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:30.428944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a6330-893d-4150-9f36-10a15792a032 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:30.438965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1294/2599] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:30.694898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:30.696350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:30.708865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f0508-2b5e-4cdc-92b0-38a5c858b348 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:30.714503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:30.715566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.715928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.716271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] PATH_INFO: `/v3/projects/a97795c4869e4c81bddfd34d9826b500` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.717816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97795c4869e4c81bddfd34d9826b500)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:30.719805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:30.765502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97795c4869e4c81bddfd34d9826b500', 'request_id': 'req-e889fd1d-aca3-4eeb-860e-ff92caf279c0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.773715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97795c4869e4c81bddfd34d9826b500', 'request_id': 'req-e889fd1d-aca3-4eeb-860e-ff92caf279c0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.779822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97795c4869e4c81bddfd34d9826b500', 'request_id': 'req-e889fd1d-aca3-4eeb-860e-ff92caf279c0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.789474 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] The token cache is being invalidate because project a97795c4869e4c81bddfd34d9826b500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:51:30.789790 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.790416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e889fd1d-aca3-4eeb-860e-ff92caf279c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:51:30.792063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1306/2600] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:51:30 2022] DELETE /identity/v3/projects/a97795c4869e4c81bddfd34d9826b500 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:51:30.798164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f96e4-c8fb-4ceb-b683-af552870cd6d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.798471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f96e4-c8fb-4ceb-b683-af552870cd6d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.798753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f96e4-c8fb-4ceb-b683-af552870cd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.815703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-329f96e4-c8fb-4ceb-b683-af552870cd6d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:30.816875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-329f96e4-c8fb-4ceb-b683-af552870cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:30.873161 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1295/2601] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:30.882167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb72bc-1e85-451d-ba09-c793e62a8300 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.882461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb72bc-1e85-451d-ba09-c793e62a8300 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.882739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb72bc-1e85-451d-ba09-c793e62a8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.902399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-92cb72bc-1e85-451d-ba09-c793e62a8300 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:30.903603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-92cb72bc-1e85-451d-ba09-c793e62a8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:30.911729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1307/2602] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:30.915904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f96e4-c8fb-4ceb-b683-af552870cd6d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:30.925469 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f96e4-c8fb-4ceb-b683-af552870cd6d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:30.930031 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:30.930680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.930959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.931231 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.931954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:51:30.932259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:30.933886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:30.946019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1296/2603] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:51:30.950339 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb72bc-1e85-451d-ba09-c793e62a8300 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:30.960668 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb72bc-1e85-451d-ba09-c793e62a8300 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:30.965499 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:30.966171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:30.966457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:30.966733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:30.967420 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:30.969335 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:30.993890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1308/2604] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:51:30 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:30.998074 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:31.008320 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd32e6-9cb0-4ed0-aa06-e5e4fa661676 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:31.061470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:31.062089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:31.062371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:31.062645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:31.063347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:31.065244 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:31.086175 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1297/2605] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:51:30 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:51:31.090169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:31.100349 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fa11-89e2-4f54-84cc-71b8ba3d46f3 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:31.105274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:31.105961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:31.106246 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:31.106523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:31.107243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:31.108835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:31.119626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1309/2606] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:31.123376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:31.133769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add95c6-4533-414a-9443-368bb6e721af admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:31.138415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911618a-9f9b-42bb-936f-ed354c584bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:31.139051 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911618a-9f9b-42bb-936f-ed354c584bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:31.139333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911618a-9f9b-42bb-936f-ed354c584bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:31.139607 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911618a-9f9b-42bb-936f-ed354c584bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:31.140323 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911618a-9f9b-42bb-936f-ed354c584bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:31.141930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911618a-9f9b-42bb-936f-ed354c584bd4 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:31.151553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1298/2607] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:51:31.155387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:31.165057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9965d2-7c73-4b17-b1d5-71adcbfa76c0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:31.169662 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:31.170542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:31.170823 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:31.171099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] PATH_INFO: `/v3/projects/53aa6a5ea19249f593bdc10504fad3e2/users/9a963e08761641ecb534617928f58d79/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:31.185504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53aa6a5ea19249f593bdc10504fad3e2, user_id=9a963e08761641ecb534617928f58d79, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:31.188194 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:31.201397 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1310/2608] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:51:31 2022] PUT /identity/v3/projects/53aa6a5ea19249f593bdc10504fad3e2/users/9a963e08761641ecb534617928f58d79/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:51:31.211851 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:31.212141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:31.212417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:31.237681 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] MFA Rules not processed for user `9a963e08761641ecb534617928f58d79`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:51:31.238891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:31.300090 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1299/2609] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:51:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:51:31.311679 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:31.313304 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:31.367964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775ad3-4c6e-455f-bfb6-6623d8f32a5c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:31.371760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:31.372396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:31.372678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:31.372954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:31.381167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:31.383215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:31.391869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1311/2610] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:51:41.043151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:51:41.044645 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:41.115682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde46055-6222-4f3d-a051-108fd7fd863a None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:51:41.121364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ea79a-79d0-4caa-8850-795226726d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:51:41.122048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea79a-79d0-4caa-8850-795226726d3d service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:51:41.122334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea79a-79d0-4caa-8850-795226726d3d service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:51:41.122616 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea79a-79d0-4caa-8850-795226726d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:51:41.124409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e44ea79a-79d0-4caa-8850-795226726d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:51:41.180264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ea79a-79d0-4caa-8850-795226726d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:51:41.181893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ea79a-79d0-4caa-8850-795226726d3d service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:51:41.191014 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1300/2611] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:51:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:06.025409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:06.086392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f69b-6613-4841-a974-abc043a730c0 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:06.090913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:06.091779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:06.092063 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:06.092344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] PATH_INFO: `/v3/users/9a963e08761641ecb534617928f58d79` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:06.093538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a963e08761641ecb534617928f58d79)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:06.095548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:06.141645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a963e08761641ecb534617928f58d79'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.149211 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a963e08761641ecb534617928f58d79'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.149917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a963e08761641ecb534617928f58d79'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.161842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a963e08761641ecb534617928f58d79'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.162526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a963e08761641ecb534617928f58d79'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.174365 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1312/2612] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:06 2022] DELETE /identity/v3/users/9a963e08761641ecb534617928f58d79 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:06.178793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:06.179284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:06.179404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:06.198431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:06.199935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:06.268466 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1301/2613] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:06.279832 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:06.281730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:06.343981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0f14-d11d-4eb3-8712-65102dd73619 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:06.347952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:06.348602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:06.348887 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:06.349162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:06.359447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:06.360913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:06.372354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1313/2614] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:52:06.795836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:06.797693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:06.812344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926490c-1782-4380-bd62-4db4d2225eb3 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:06.820081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:06.822646 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:06.823233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:06.823860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] PATH_INFO: `/v3/projects/53aa6a5ea19249f593bdc10504fad3e2` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:06.825911 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] RBAC: Authorizing `identity:delete_project(project_id=53aa6a5ea19249f593bdc10504fad3e2)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:06.829228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:06.908910 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53aa6a5ea19249f593bdc10504fad3e2', 'request_id': 'req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.917797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53aa6a5ea19249f593bdc10504fad3e2', 'request_id': 'req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.924229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53aa6a5ea19249f593bdc10504fad3e2', 'request_id': 'req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.935889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] The token cache is being invalidate because project 53aa6a5ea19249f593bdc10504fad3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:06.936504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.937392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:06.939039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1302/2615] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:06 2022] DELETE /identity/v3/projects/53aa6a5ea19249f593bdc10504fad3e2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:11.786225 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:11.794580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2434f-53de-4bd1-abf9-94a66fc5a5f0 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:11.841333 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:11.841989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:11.842271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:11.842540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:11.844279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:11.904926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:11.906381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:11.915686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1314/2616] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:16.035160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.041814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:16.061984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab777e-5b7c-4e10-8b0f-d6fb523e92de admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.067532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.068404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.069389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.069544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] PATH_INFO: `/v3/users/97227abbbafa46f1b0660e3be2ceea70` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.071094 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=97227abbbafa46f1b0660e3be2ceea70)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.080692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.140763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97227abbbafa46f1b0660e3be2ceea70'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.148437 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97227abbbafa46f1b0660e3be2ceea70'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.149165 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97227abbbafa46f1b0660e3be2ceea70'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.161975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97227abbbafa46f1b0660e3be2ceea70'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.162762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-8646e8cb-d058-4717-a36c-e90d896e06dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97227abbbafa46f1b0660e3be2ceea70'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.176431 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1303/2617] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:16 2022] DELETE /identity/v3/users/97227abbbafa46f1b0660e3be2ceea70 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:16.362233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.373039 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5e22-92fd-42e1-8ded-449683b852c8 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.430538 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.431404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.431686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.432503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] PATH_INFO: `/v3/projects/d51975fc708d49efa56621b0fd19c47f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.433687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51975fc708d49efa56621b0fd19c47f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.435670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.484319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51975fc708d49efa56621b0fd19c47f', 'request_id': 'req-7e90c5e1-01d4-44c2-ae29-45581a0986e6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.492087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51975fc708d49efa56621b0fd19c47f', 'request_id': 'req-7e90c5e1-01d4-44c2-ae29-45581a0986e6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.499815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51975fc708d49efa56621b0fd19c47f', 'request_id': 'req-7e90c5e1-01d4-44c2-ae29-45581a0986e6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.511690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] The token cache is being invalidate because project d51975fc708d49efa56621b0fd19c47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:16.511974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.512633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7e90c5e1-01d4-44c2-ae29-45581a0986e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:16.514217 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1315/2618] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:16 2022] DELETE /identity/v3/projects/d51975fc708d49efa56621b0fd19c47f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:16.519160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb140f3-9c2c-4964-bfca-775f6d18e405 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.519542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb140f3-9c2c-4964-bfca-775f6d18e405 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.519918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb140f3-9c2c-4964-bfca-775f6d18e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.537474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-aeb140f3-9c2c-4964-bfca-775f6d18e405 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:16.538960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-aeb140f3-9c2c-4964-bfca-775f6d18e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:16.608405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1304/2619] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:16.616124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3b46-a43e-4cac-b909-d539d2944afe None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.616415 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3b46-a43e-4cac-b909-d539d2944afe None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.616697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3b46-a43e-4cac-b909-d539d2944afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.637902 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-e68c3b46-a43e-4cac-b909-d539d2944afe None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:16.639154 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e68c3b46-a43e-4cac-b909-d539d2944afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:16.647202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1316/2620] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:16.651723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb140f3-9c2c-4964-bfca-775f6d18e405 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.661501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb140f3-9c2c-4964-bfca-775f6d18e405 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.668254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.668924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.669206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.669510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.670290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:52:16.670597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.672206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.684195 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1305/2621] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:52:16.688602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3b46-a43e-4cac-b909-d539d2944afe None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.698129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3b46-a43e-4cac-b909-d539d2944afe None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.702760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.703402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.703681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.703952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.704641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.706583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.730563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1317/2622] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:16 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:16.734603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.744917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51ee9a-2874-4fcf-ae32-2b229d1db8be admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.798759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.799409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.799690 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.800065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.800647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.802582 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.821227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1306/2623] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:16 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:16.825387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.835758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e868814-6ff5-4e82-8f3b-bd4281580eea admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.840861 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.841514 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.841927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.842209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.842940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.844730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.857546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1318/2624] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:16.861813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.879656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14f97-48b3-4c69-8cdc-a9da2e950c41 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.884303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59423b-3ed5-4213-a93a-dfbe2105c47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.884951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59423b-3ed5-4213-a93a-dfbe2105c47d admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.885233 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59423b-3ed5-4213-a93a-dfbe2105c47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.885507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59423b-3ed5-4213-a93a-dfbe2105c47d admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.886265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59423b-3ed5-4213-a93a-dfbe2105c47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.887854 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59423b-3ed5-4213-a93a-dfbe2105c47d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.898673 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1307/2625] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:16.902884 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:16.913546 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2bca6-93eb-4e7d-a80d-211fe20a01ea admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:16.918694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:16.919558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.919837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.920108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] PATH_INFO: `/v3/projects/538441ae9b63481b8c22ddeb6570f175/users/03e97d749f634d7ca1b8c9e9eadbd2d6/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.934520 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538441ae9b63481b8c22ddeb6570f175, user_id=03e97d749f634d7ca1b8c9e9eadbd2d6, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:16.937197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:16.949275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1319/2626] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:16 2022] PUT /identity/v3/projects/538441ae9b63481b8c22ddeb6570f175/users/03e97d749f634d7ca1b8c9e9eadbd2d6/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:16.960765 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:16.960935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:16.961213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:16.990623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] MFA Rules not processed for user `03e97d749f634d7ca1b8c9e9eadbd2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:16.991896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:17.059715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1308/2627] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:17.070508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:17.072590 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:17.144108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ee121-2202-4368-9446-f476036bd0a0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:17.149416 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:17.150087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:17.150368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:17.151147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:17.158615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:17.160189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:17.169534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1320/2628] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:18.952988 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:18.954445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:19.011713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b24c-9bba-4e20-9a10-d55fd2f2658d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:19.015216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6b0a2-06f0-40d7-a902-4645673cb7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:19.015847 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b0a2-06f0-40d7-a902-4645673cb7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:19.016128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b0a2-06f0-40d7-a902-4645673cb7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:19.016404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b0a2-06f0-40d7-a902-4645673cb7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:19.018156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-87d6b0a2-06f0-40d7-a902-4645673cb7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:19.079800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6b0a2-06f0-40d7-a902-4645673cb7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:19.081218 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6b0a2-06f0-40d7-a902-4645673cb7c5 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:19.091510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1309/2629] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:52:19.807168 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:19.817424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc8b9a-0207-4d9b-a4bf-923437dc7e4d service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:19.821980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:19.823394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:19.823678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:19.824044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] PATH_INFO: `/v3/users/03e97d749f634d7ca1b8c9e9eadbd2d6` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:19.825242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e97d749f634d7ca1b8c9e9eadbd2d6)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:19.827202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:19.872363 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e97d749f634d7ca1b8c9e9eadbd2d6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:19.879522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e97d749f634d7ca1b8c9e9eadbd2d6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:19.880202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e97d749f634d7ca1b8c9e9eadbd2d6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:19.892035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e97d749f634d7ca1b8c9e9eadbd2d6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:19.892673 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e97d749f634d7ca1b8c9e9eadbd2d6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:19.905014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1321/2630] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:19 2022] DELETE /identity/v3/users/03e97d749f634d7ca1b8c9e9eadbd2d6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:19.909471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677e82d-69af-4242-889c-e510db65715f None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:19.909870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677e82d-69af-4242-889c-e510db65715f None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:19.910154 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677e82d-69af-4242-889c-e510db65715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:19.927341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8677e82d-69af-4242-889c-e510db65715f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:19.928555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8677e82d-69af-4242-889c-e510db65715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:19.992600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1310/2631] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:20.003731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.005215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:20.070436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddc38-4de0-47fd-8170-8d7a8161f7be admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.074276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a7ba3-1ff7-46b5-b1b3-0cb3f4e15a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.074952 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a7ba3-1ff7-46b5-b1b3-0cb3f4e15a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.075227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a7ba3-1ff7-46b5-b1b3-0cb3f4e15a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.075505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a7ba3-1ff7-46b5-b1b3-0cb3f4e15a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.085722 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a7ba3-1ff7-46b5-b1b3-0cb3f4e15a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.087306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a7ba3-1ff7-46b5-b1b3-0cb3f4e15a10 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.098059 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1322/2632] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:20.376678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677e82d-69af-4242-889c-e510db65715f None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.378286 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8677e82d-69af-4242-889c-e510db65715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:20.391548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677e82d-69af-4242-889c-e510db65715f None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.396392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.397267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.397548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.397907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] PATH_INFO: `/v3/projects/538441ae9b63481b8c22ddeb6570f175` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.399088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538441ae9b63481b8c22ddeb6570f175)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.401083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.450974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538441ae9b63481b8c22ddeb6570f175', 'request_id': 'req-19a73688-828d-452d-921a-00033fa17d82'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:20.459635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538441ae9b63481b8c22ddeb6570f175', 'request_id': 'req-19a73688-828d-452d-921a-00033fa17d82'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:20.466222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538441ae9b63481b8c22ddeb6570f175', 'request_id': 'req-19a73688-828d-452d-921a-00033fa17d82'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:20.476506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] The token cache is being invalidate because project 538441ae9b63481b8c22ddeb6570f175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:20.476795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:20.477452 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-19a73688-828d-452d-921a-00033fa17d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:20.479119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1311/2633] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:20 2022] DELETE /identity/v3/projects/538441ae9b63481b8c22ddeb6570f175 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:20.484143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d60a5-30f2-46bd-bcf4-afa7cf2af90f None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.484472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d60a5-30f2-46bd-bcf4-afa7cf2af90f None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.484755 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d60a5-30f2-46bd-bcf4-afa7cf2af90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.504170 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-1d2d60a5-30f2-46bd-bcf4-afa7cf2af90f None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:20.505401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1d2d60a5-30f2-46bd-bcf4-afa7cf2af90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:20.565414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1323/2634] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:20.573193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bd414-095e-4d95-8357-0c5b9dfaed52 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.573478 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bd414-095e-4d95-8357-0c5b9dfaed52 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.573798 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bd414-095e-4d95-8357-0c5b9dfaed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.592300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0d8bd414-095e-4d95-8357-0c5b9dfaed52 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:20.593520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0d8bd414-095e-4d95-8357-0c5b9dfaed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:20.601508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1312/2635] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:20.606354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d60a5-30f2-46bd-bcf4-afa7cf2af90f None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.615914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d60a5-30f2-46bd-bcf4-afa7cf2af90f None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.621160 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.621859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.622153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.622430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.623157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:52:20.623465 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.625058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.637242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1324/2636] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:52:20.641510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bd414-095e-4d95-8357-0c5b9dfaed52 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.651609 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bd414-095e-4d95-8357-0c5b9dfaed52 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.656491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.657204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.657492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.657805 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.658501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.660416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.689062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1313/2637] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:20 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:20.690202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.700865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4894dc-e2cd-4da1-b08e-db068bc123eb admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.755101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.755775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.756067 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.756346 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.757049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.759028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.782380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1325/2638] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:20 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:20.786511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.796980 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9836b9-7c71-4d54-a26e-5e33e557eeda admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.801900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.802559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.802844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.803137 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.803853 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.805462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.816342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1314/2639] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:52:20.820429 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.831501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695e0d2-cae0-44aa-b7ab-319123038b9c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.837301 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966291a-6652-451b-95c0-85b2c6f9cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.838816 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966291a-6652-451b-95c0-85b2c6f9cf2a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.839186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966291a-6652-451b-95c0-85b2c6f9cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.839540 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966291a-6652-451b-95c0-85b2c6f9cf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.840341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966291a-6652-451b-95c0-85b2c6f9cf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.842057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966291a-6652-451b-95c0-85b2c6f9cf2a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.852472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1326/2640] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:20.856900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:20.866923 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c440d0-f81d-4517-b270-b8fdf1c18d53 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:20.871311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:20.872150 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.872441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.872759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] PATH_INFO: `/v3/projects/1057f1b755a34ec9b8cb3141f495734e/users/c9e61ec7a9ed4620a696527c38de94f6/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.896623 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1057f1b755a34ec9b8cb3141f495734e, user_id=c9e61ec7a9ed4620a696527c38de94f6, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:20.900454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:20.918568 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1315/2641] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:20 2022] PUT /identity/v3/projects/1057f1b755a34ec9b8cb3141f495734e/users/c9e61ec7a9ed4620a696527c38de94f6/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:52:20.929656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601380-e2ab-4593-a40c-316078b2329c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:20.929879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601380-e2ab-4593-a40c-316078b2329c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:20.930004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601380-e2ab-4593-a40c-316078b2329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:20.958550 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a5601380-e2ab-4593-a40c-316078b2329c None None] MFA Rules not processed for user `c9e61ec7a9ed4620a696527c38de94f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:20.960502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a5601380-e2ab-4593-a40c-316078b2329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:21.056237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1327/2642] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:21.057421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.123521 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e3ccf-8aef-4066-b156-142e26bedfdc admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.128889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.129635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.129856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.130488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.130833 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.133407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.164450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1316/2643] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:21 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:21.168967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5601380-e2ab-4593-a40c-316078b2329c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.180400 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5601380-e2ab-4593-a40c-316078b2329c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.238961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.239746 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.240089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.240454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.241221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.243308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.267528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1328/2644] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:21 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:52:21.268697 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.279496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c1822-0ded-40bc-8abc-beb4f9e291e6 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.284635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.285300 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.285926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.286349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.287432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.288802 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.301618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1317/2645] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:21.305840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.316079 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79c4c5-d085-4255-a5b3-3947db64efcc admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.321100 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.322084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.323004 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.323428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] PATH_INFO: `/v3/projects/9c8da101b7d24fe89af03be56828938d/users/d7d9d2b5dab9410eaf06756150e94b43/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.340290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8da101b7d24fe89af03be56828938d, user_id=d7d9d2b5dab9410eaf06756150e94b43, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.343281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.364525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1329/2646] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:21 2022] PUT /identity/v3/projects/9c8da101b7d24fe89af03be56828938d/users/d7d9d2b5dab9410eaf06756150e94b43/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:21.368600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.379099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d309a93-bd58-4782-b8de-769c1892b841 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.436550 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d8d78-b89b-4bed-9085-36e9918601d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.437213 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d8d78-b89b-4bed-9085-36e9918601d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.437491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d8d78-b89b-4bed-9085-36e9918601d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.437791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d8d78-b89b-4bed-9085-36e9918601d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.438510 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d8d78-b89b-4bed-9085-36e9918601d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.440080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d8d78-b89b-4bed-9085-36e9918601d8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.452434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1318/2647] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:21.454796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.466134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d8aa9-cbaa-476f-b5b4-778eaecd0a81 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.470859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.471809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.472158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.472500 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] PATH_INFO: `/v3/projects/9c8da101b7d24fe89af03be56828938d/users/d7d9d2b5dab9410eaf06756150e94b43/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.474685 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8da101b7d24fe89af03be56828938d, user_id=d7d9d2b5dab9410eaf06756150e94b43, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.477414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.487814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1330/2648] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:21 2022] PUT /identity/v3/projects/9c8da101b7d24fe89af03be56828938d/users/d7d9d2b5dab9410eaf06756150e94b43/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:21.502523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.503033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.503309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.530907 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] MFA Rules not processed for user `d7d9d2b5dab9410eaf06756150e94b43`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:21.532220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:21.601658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1319/2649] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:21.613069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.614780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:21.678476 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e26f6a-af1d-4601-b751-c2c98713027b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.682693 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.683344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.683625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.683901 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.693532 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.695037 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.708062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1331/2650] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:21.757932 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:21.759432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:21.772830 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1bff8-f300-428c-8eea-2cae229784ee None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:21.778377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:21.778377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:21.778377 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:21.781481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:21.840341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:21.841889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:21.852227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1320/2651] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:52:22.472298 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:22.473798 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:22.543644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df9c0-c87a-4ae0-a382-b37a984665af service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:22.548296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:22.549153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:22.549428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:22.549718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] PATH_INFO: `/v3/users/635d1cf64110483b843b01e6e6ddc749` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:22.550919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=635d1cf64110483b843b01e6e6ddc749)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:22.552828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:22.596307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635d1cf64110483b843b01e6e6ddc749'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.603151 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635d1cf64110483b843b01e6e6ddc749'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.603802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635d1cf64110483b843b01e6e6ddc749'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.615381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635d1cf64110483b843b01e6e6ddc749'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.615968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-97d9d442-9b24-4aeb-8d92-7a5e8d7912dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635d1cf64110483b843b01e6e6ddc749'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.628353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1332/2652] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:22 2022] DELETE /identity/v3/users/635d1cf64110483b843b01e6e6ddc749 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:22.790544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:22.803027 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be19d5-08ce-405f-82f5-39995495a344 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:22.858660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:22.859498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:22.859762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:22.860064 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] PATH_INFO: `/v3/projects/079cb1c02174440091d4c5bcbc27bdc5` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:22.861325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] RBAC: Authorizing `identity:delete_project(project_id=079cb1c02174440091d4c5bcbc27bdc5)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:22.863274 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:22.907743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '079cb1c02174440091d4c5bcbc27bdc5', 'request_id': 'req-a3c092bb-b502-40aa-8d40-67e640fb863c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.914400 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '079cb1c02174440091d4c5bcbc27bdc5', 'request_id': 'req-a3c092bb-b502-40aa-8d40-67e640fb863c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.920330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '079cb1c02174440091d4c5bcbc27bdc5', 'request_id': 'req-a3c092bb-b502-40aa-8d40-67e640fb863c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.930110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] The token cache is being invalidate because project 079cb1c02174440091d4c5bcbc27bdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:22.930414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.931030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a3c092bb-b502-40aa-8d40-67e640fb863c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:22.932555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1321/2653] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:22 2022] DELETE /identity/v3/projects/079cb1c02174440091d4c5bcbc27bdc5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:52:22.937448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12b432-fb30-4a90-9cda-d16c6519a94b None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:22.937762 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12b432-fb30-4a90-9cda-d16c6519a94b None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:22.938054 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12b432-fb30-4a90-9cda-d16c6519a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:22.955836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-1d12b432-fb30-4a90-9cda-d16c6519a94b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:22.957015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1d12b432-fb30-4a90-9cda-d16c6519a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:23.016959 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1333/2654] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:23.024965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82c23-4648-4bb4-aff7-7482372ce76d None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.025349 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82c23-4648-4bb4-aff7-7482372ce76d None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.025806 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82c23-4648-4bb4-aff7-7482372ce76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.046332 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-5fe82c23-4648-4bb4-aff7-7482372ce76d None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:23.047557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5fe82c23-4648-4bb4-aff7-7482372ce76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:23.056105 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1322/2655] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:23.060860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12b432-fb30-4a90-9cda-d16c6519a94b None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:23.070265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12b432-fb30-4a90-9cda-d16c6519a94b None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:23.074896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:23.075543 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.075822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.076152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.076876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:52:23.077187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:23.078808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:23.090392 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1334/2656] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:52:23.094615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe82c23-4648-4bb4-aff7-7482372ce76d None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:23.104831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe82c23-4648-4bb4-aff7-7482372ce76d None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:23.109542 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:23.110177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.110463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.110742 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.111477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:23.113383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:23.138726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1323/2657] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:23 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:52:23.142883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:23.153310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812b4da-4022-4e01-91b4-c792a4eb2e6f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:23.209504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:23.210200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.210486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.210763 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.211461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:23.214291 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:23.233632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1335/2658] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:23 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:23.237693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:23.247886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ca4c7-8a0c-4684-95d0-a52b57419b59 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:23.252709 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:23.253358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.253903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.254271 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.254957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:23.256860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:23.267569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1324/2659] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:23.271637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:23.281923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d3061-584b-444f-8d3a-5b2f610f2c75 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:23.286624 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01954a1-9d24-4a7c-9d5b-278223b2f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:23.287355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01954a1-9d24-4a7c-9d5b-278223b2f55a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.287641 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01954a1-9d24-4a7c-9d5b-278223b2f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.287919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01954a1-9d24-4a7c-9d5b-278223b2f55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.288645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01954a1-9d24-4a7c-9d5b-278223b2f55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:23.290271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01954a1-9d24-4a7c-9d5b-278223b2f55a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:23.300885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1336/2660] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:23.304972 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:23.318127 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163512-eb81-4f3d-a04c-fcd897db1a23 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:23.324457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:23.325361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.325639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.325937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] PATH_INFO: `/v3/projects/b284fcbfe0214240a616a6d68cedfed2/users/61fcd9d503734952b0ea9ec6ef96be6c/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.340917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b284fcbfe0214240a616a6d68cedfed2, user_id=61fcd9d503734952b0ea9ec6ef96be6c, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:23.344283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:23.358180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1325/2661] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:23 2022] PUT /identity/v3/projects/b284fcbfe0214240a616a6d68cedfed2/users/61fcd9d503734952b0ea9ec6ef96be6c/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:23.363526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.363843 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.364124 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.382714 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:23.383907 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:23.457861 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1337/2662] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:23.467918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:23.469822 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:23.527083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab336dc-6d62-49b4-8702-503733899bf9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:23.530741 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df19a46-b397-4e1e-8fc6-c7da2a605aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:23.531385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df19a46-b397-4e1e-8fc6-c7da2a605aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:23.531685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df19a46-b397-4e1e-8fc6-c7da2a605aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:23.531943 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df19a46-b397-4e1e-8fc6-c7da2a605aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:23.542797 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df19a46-b397-4e1e-8fc6-c7da2a605aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:23.544345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df19a46-b397-4e1e-8fc6-c7da2a605aa9 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:23.554338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1326/2663] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:25.359961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:25.361974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:25.374508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea6fd-78ae-40fa-a2a2-140ad9c28d6e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:25.379285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:25.380173 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:25.380458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:25.380728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] PATH_INFO: `/v3/users/c9e61ec7a9ed4620a696527c38de94f6` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:25.381991 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e61ec7a9ed4620a696527c38de94f6)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:25.383956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:25.434760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e61ec7a9ed4620a696527c38de94f6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:25.442528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e61ec7a9ed4620a696527c38de94f6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:25.443190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e61ec7a9ed4620a696527c38de94f6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:25.465733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e61ec7a9ed4620a696527c38de94f6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:25.466527 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e61ec7a9ed4620a696527c38de94f6'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:25.479369 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1338/2664] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:25 2022] DELETE /identity/v3/users/c9e61ec7a9ed4620a696527c38de94f6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:25.484073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:25.484629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:25.484750 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:25.506239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:25.509206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:25.575809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1327/2665] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:25.585637 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:25.587103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:25.647193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b134-5265-4cb4-8142-466e0de9ed89 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:25.652380 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:25.653260 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:25.653545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:25.653885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:25.663841 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:25.665680 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:25.676307 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1339/2666] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:25.981095 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:25.982794 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:26.002488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba998de-65b5-421c-a84c-fab34f9bb7a6 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:26.012330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:26.013739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:26.014210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:26.014680 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] PATH_INFO: `/v3/projects/1057f1b755a34ec9b8cb3141f495734e` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:26.018660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1057f1b755a34ec9b8cb3141f495734e)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:26.024533 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:26.096537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1057f1b755a34ec9b8cb3141f495734e', 'request_id': 'req-debcf8d2-c95f-4453-a5b7-c948ba15aa20'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.112153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1057f1b755a34ec9b8cb3141f495734e', 'request_id': 'req-debcf8d2-c95f-4453-a5b7-c948ba15aa20'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.120091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1057f1b755a34ec9b8cb3141f495734e', 'request_id': 'req-debcf8d2-c95f-4453-a5b7-c948ba15aa20'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.132793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] The token cache is being invalidate because project 1057f1b755a34ec9b8cb3141f495734e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:26.133381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.134386 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.136461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1328/2667] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:25 2022] DELETE /identity/v3/projects/1057f1b755a34ec9b8cb3141f495734e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:26.140581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:26.151450 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812cd57-23d3-4d51-9f13-a692f5229396 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:26.216964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:26.217892 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:26.218179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:26.218460 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] PATH_INFO: `/v3/users/d7d9d2b5dab9410eaf06756150e94b43` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:26.219704 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d9d2b5dab9410eaf06756150e94b43)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:26.221670 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:26.278862 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d9d2b5dab9410eaf06756150e94b43'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.287034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d9d2b5dab9410eaf06756150e94b43'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.287227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d9d2b5dab9410eaf06756150e94b43'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.311240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d9d2b5dab9410eaf06756150e94b43'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.312403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-7b0efd97-9fd1-407b-84a8-8de4fec1e39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d9d2b5dab9410eaf06756150e94b43'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.342019 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1340/2668] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:26 2022] DELETE /identity/v3/users/d7d9d2b5dab9410eaf06756150e94b43 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:26.658563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:26.660863 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:26.678264 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcf8d2-c95f-4453-a5b7-c948ba15aa20 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:26.743855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:26.744759 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:26.745242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:26.745520 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] PATH_INFO: `/v3/projects/9c8da101b7d24fe89af03be56828938d` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:26.750288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8da101b7d24fe89af03be56828938d)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:26.752253 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:26.802986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8da101b7d24fe89af03be56828938d', 'request_id': 'req-7a455cdf-9eef-45c2-9a67-e899c0f3e178'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.812229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8da101b7d24fe89af03be56828938d', 'request_id': 'req-7a455cdf-9eef-45c2-9a67-e899c0f3e178'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.820612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8da101b7d24fe89af03be56828938d', 'request_id': 'req-7a455cdf-9eef-45c2-9a67-e899c0f3e178'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.834062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] The token cache is being invalidate because project 9c8da101b7d24fe89af03be56828938d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:26.834411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.835093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-7a455cdf-9eef-45c2-9a67-e899c0f3e178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:26.836902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1329/2669] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:26 2022] DELETE /identity/v3/projects/9c8da101b7d24fe89af03be56828938d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:26.842139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd0ee6-cbfd-418b-bf5a-89fa2c4670e1 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:26.842961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd0ee6-cbfd-418b-bf5a-89fa2c4670e1 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:26.843443 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd0ee6-cbfd-418b-bf5a-89fa2c4670e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:26.862218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-87cd0ee6-cbfd-418b-bf5a-89fa2c4670e1 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:26.863720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-87cd0ee6-cbfd-418b-bf5a-89fa2c4670e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:26.927308 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1341/2670] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:26.935751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76da2c-c5af-45fb-93fe-d2b7c9279607 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:26.936255 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76da2c-c5af-45fb-93fe-d2b7c9279607 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:26.936613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76da2c-c5af-45fb-93fe-d2b7c9279607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:26.959016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7b76da2c-c5af-45fb-93fe-d2b7c9279607 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:26.960071 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7b76da2c-c5af-45fb-93fe-d2b7c9279607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:26.970388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1330/2671] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:26.978378 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd0ee6-cbfd-418b-bf5a-89fa2c4670e1 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:26.991910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd0ee6-cbfd-418b-bf5a-89fa2c4670e1 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.006992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.007672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.007951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.008221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.008964 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:52:27.009269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.011593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.028432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1342/2672] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:52:27.030273 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76da2c-c5af-45fb-93fe-d2b7c9279607 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.044532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76da2c-c5af-45fb-93fe-d2b7c9279607 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.051778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.052504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.052784 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.053514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.054433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.059072 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.100777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1331/2673] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:27 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:27.104310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.117030 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857d10-0231-4616-b9b7-cb0c3ae1efb6 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.199950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.200770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.201056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.201424 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.202158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.204268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.229056 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1343/2674] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:27 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:52:27.233146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.243404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554dc6c-b26f-48b3-8ce0-bd21afc32b03 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.249372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.250078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.250371 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.250637 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.251375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.252954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.267450 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1332/2675] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:27.271551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.284969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c145-276a-4e5f-94f0-96560a46df67 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.292012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0732604-cfae-4d77-be98-00988d20646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.293040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0732604-cfae-4d77-be98-00988d20646c admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.293321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0732604-cfae-4d77-be98-00988d20646c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.293597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0732604-cfae-4d77-be98-00988d20646c admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.294501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0732604-cfae-4d77-be98-00988d20646c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.296200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0732604-cfae-4d77-be98-00988d20646c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.316965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1344/2676] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:27.317785 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.329693 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a53cc-cd5c-4f60-ace1-b0191206563f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.335099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.337499 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.337837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.338153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] PATH_INFO: `/v3/projects/c41991b08b4e46559a9979349d7ba7b6/users/2bf5a2400ff14a49876712e6a0ff2fc3/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.360207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41991b08b4e46559a9979349d7ba7b6, user_id=2bf5a2400ff14a49876712e6a0ff2fc3, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.364199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.382811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1333/2677] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:27 2022] PUT /identity/v3/projects/c41991b08b4e46559a9979349d7ba7b6/users/2bf5a2400ff14a49876712e6a0ff2fc3/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:52:27.394201 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8bc66-03b9-494a-b282-567fec175797 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.394486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8bc66-03b9-494a-b282-567fec175797 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.394769 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8bc66-03b9-494a-b282-567fec175797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.430656 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-58c8bc66-03b9-494a-b282-567fec175797 None None] MFA Rules not processed for user `2bf5a2400ff14a49876712e6a0ff2fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:27.431933 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58c8bc66-03b9-494a-b282-567fec175797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:27.526195 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1345/2678] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:27.530210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.607813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c4ac9-aa9e-4415-ab2c-da7af0ef590e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.613426 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.614132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.614417 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.614726 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.615451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.617391 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.647691 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1334/2679] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:27 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:52:27.649007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8bc66-03b9-494a-b282-567fec175797 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.662761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8bc66-03b9-494a-b282-567fec175797 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.739065 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.739750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.740028 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.740306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.741000 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.743145 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.773127 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1346/2680] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:27 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:27.781501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.795298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5653b-edf7-4d5b-acdf-c0733f545006 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.807324 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.808083 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.808434 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.808777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.809583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.811283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.826905 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1335/2681] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:27.831511 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.842954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b557f-392c-47b5-bb86-1903861bfbe4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.847987 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.848960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.849462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.849877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] PATH_INFO: `/v3/projects/dc49bf7605d04a73988db50e0d7efac0/users/81574299a24349f5a58a80feece07bd8/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.866202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc49bf7605d04a73988db50e0d7efac0, user_id=81574299a24349f5a58a80feece07bd8, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.868869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.887408 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1347/2682] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:27 2022] PUT /identity/v3/projects/dc49bf7605d04a73988db50e0d7efac0/users/81574299a24349f5a58a80feece07bd8/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:27.891378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:27.902838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58a2dd-52b0-4a1c-959e-8f3f2effc11f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:27.966338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e81004-6674-40c7-b225-5786bbcb07f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:27.967024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81004-6674-40c7-b225-5786bbcb07f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:27.967369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81004-6674-40c7-b225-5786bbcb07f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:27.967708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81004-6674-40c7-b225-5786bbcb07f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:27.968523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e81004-6674-40c7-b225-5786bbcb07f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:27.970487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e81004-6674-40c7-b225-5786bbcb07f9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:27.982682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1336/2683] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:27.986462 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:28.000507 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5d209-b4f3-4cce-89c2-25b4f1cf05ca admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:28.006334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f725f-8965-4d03-9472-25df6337b616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:28.007375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f725f-8965-4d03-9472-25df6337b616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.007729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f725f-8965-4d03-9472-25df6337b616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.008076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f725f-8965-4d03-9472-25df6337b616 admin admin] PATH_INFO: `/v3/projects/dc49bf7605d04a73988db50e0d7efac0/users/81574299a24349f5a58a80feece07bd8/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.010842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f725f-8965-4d03-9472-25df6337b616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc49bf7605d04a73988db50e0d7efac0, user_id=81574299a24349f5a58a80feece07bd8, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:28.013761 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f725f-8965-4d03-9472-25df6337b616 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:28.027805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1348/2684] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:27 2022] PUT /identity/v3/projects/dc49bf7605d04a73988db50e0d7efac0/users/81574299a24349f5a58a80feece07bd8/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:28.037894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.038694 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.039103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.075282 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] MFA Rules not processed for user `81574299a24349f5a58a80feece07bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:28.082219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:28.185581 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1337/2685] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:28.189931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345cf8-86e6-4408-8a3f-901fab13546d None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.189931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345cf8-86e6-4408-8a3f-901fab13546d None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.189931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4345cf8-86e6-4408-8a3f-901fab13546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.199338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:28.200848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:28.247168 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c4345cf8-86e6-4408-8a3f-901fab13546d None None] MFA Rules not processed for user `61fcd9d503734952b0ea9ec6ef96be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:28.249360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c4345cf8-86e6-4408-8a3f-901fab13546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:28.264164 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d640f7d-f776-4ee0-ab21-df2e268a2f51 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:28.267960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:28.268618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.268900 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.269174 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.279454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:28.280896 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:28.293877 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1338/2686] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:52:28.333813 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1349/2687] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:28.343831 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:28.345532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:28.367312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4345cf8-86e6-4408-8a3f-901fab13546d None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:28.377456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4345cf8-86e6-4408-8a3f-901fab13546d None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:28.381236 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17f8b0-539e-45e0-a641-f5cb87960938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:28.381923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f8b0-539e-45e0-a641-f5cb87960938 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.382212 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f8b0-539e-45e0-a641-f5cb87960938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.382494 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f8b0-539e-45e0-a641-f5cb87960938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.434790 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227407b-7ec0-4a18-8df7-29e191ea1a1e service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:28.440957 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:28.441600 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.441917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.442191 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.451509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:28.453256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:28.455469 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f8b0-539e-45e0-a641-f5cb87960938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:28.457050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f8b0-539e-45e0-a641-f5cb87960938 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:28.463289 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1339/2688] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:28.474167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1350/2689] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:28.755583 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:28.820149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85c680-bffc-49b5-bb4d-37b6596a859d service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:28.825647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:28.826612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.826899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.827187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] PATH_INFO: `/v3/users/2bf5a2400ff14a49876712e6a0ff2fc3` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.828416 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf5a2400ff14a49876712e6a0ff2fc3)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:28.830384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:28.878620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf5a2400ff14a49876712e6a0ff2fc3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:28.886708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf5a2400ff14a49876712e6a0ff2fc3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:28.887511 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf5a2400ff14a49876712e6a0ff2fc3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:28.901945 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf5a2400ff14a49876712e6a0ff2fc3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:28.902757 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf5a2400ff14a49876712e6a0ff2fc3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:28.923024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1340/2690] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:28 2022] DELETE /identity/v3/users/2bf5a2400ff14a49876712e6a0ff2fc3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:28.927530 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:28.927998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:28.928137 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:28.948062 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:28.949815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:29.035274 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1351/2691] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:52:29.045485 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:29.048012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:29.144361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17671000-ff98-434b-81e5-8927147e4008 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:29.144361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:29.144361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:29.144361 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:29.144746 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:29.149013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:29.151287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:29.165419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1341/2692] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 11:52:29.527318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:29.529026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:29.545461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90db79-a85d-4472-82c4-a85be8017636 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:29.550980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:29.552152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:29.552441 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:29.552729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] PATH_INFO: `/v3/projects/c41991b08b4e46559a9979349d7ba7b6` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:29.554188 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41991b08b4e46559a9979349d7ba7b6)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:29.556675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:29.617596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41991b08b4e46559a9979349d7ba7b6', 'request_id': 'req-24fbce6e-00ff-4ca0-888d-93600316eab5'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.629877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41991b08b4e46559a9979349d7ba7b6', 'request_id': 'req-24fbce6e-00ff-4ca0-888d-93600316eab5'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.637020 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41991b08b4e46559a9979349d7ba7b6', 'request_id': 'req-24fbce6e-00ff-4ca0-888d-93600316eab5'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.648928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] The token cache is being invalidate because project c41991b08b4e46559a9979349d7ba7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:29.649237 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.650221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-24fbce6e-00ff-4ca0-888d-93600316eab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.651768 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1352/2693] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:29 2022] DELETE /identity/v3/projects/c41991b08b4e46559a9979349d7ba7b6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:29.655692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:29.665508 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82e10-84be-4418-9c21-44782b52879b service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:29.725383 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:29.726315 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:29.726598 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:29.727256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] PATH_INFO: `/v3/users/81574299a24349f5a58a80feece07bd8` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:29.728070 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81574299a24349f5a58a80feece07bd8)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:29.730579 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:29.778438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81574299a24349f5a58a80feece07bd8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.785743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81574299a24349f5a58a80feece07bd8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.786468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81574299a24349f5a58a80feece07bd8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.799045 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81574299a24349f5a58a80feece07bd8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.799754 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81574299a24349f5a58a80feece07bd8'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:29.814652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1342/2694] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:29 2022] DELETE /identity/v3/users/81574299a24349f5a58a80feece07bd8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:29.902161 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e33d-33bc-41c5-ade0-d7d090790b17 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:29.902446 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e33d-33bc-41c5-ade0-d7d090790b17 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:29.902720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e33d-33bc-41c5-ade0-d7d090790b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:29.921383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-37e6e33d-33bc-41c5-ade0-d7d090790b17 None None] MFA Rules not processed for user `61fcd9d503734952b0ea9ec6ef96be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:29.922618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-37e6e33d-33bc-41c5-ade0-d7d090790b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:30.006694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1353/2695] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:30.103752 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:30.105814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:30.180906 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d342-acba-40a4-8ca8-adb06c32b262 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:30.194012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:30.195260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.195548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.195832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] PATH_INFO: `/v3/projects/dc49bf7605d04a73988db50e0d7efac0` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.197684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc49bf7605d04a73988db50e0d7efac0)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:30.199867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:30.271793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc49bf7605d04a73988db50e0d7efac0', 'request_id': 'req-93e65be4-1d4b-4fb5-8584-682835fb3ee6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:30.280897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc49bf7605d04a73988db50e0d7efac0', 'request_id': 'req-93e65be4-1d4b-4fb5-8584-682835fb3ee6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:30.289522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc49bf7605d04a73988db50e0d7efac0', 'request_id': 'req-93e65be4-1d4b-4fb5-8584-682835fb3ee6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:30.302818 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] The token cache is being invalidate because project dc49bf7605d04a73988db50e0d7efac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:30.303171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:30.303894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-93e65be4-1d4b-4fb5-8584-682835fb3ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:30.305867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1343/2696] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:30 2022] DELETE /identity/v3/projects/dc49bf7605d04a73988db50e0d7efac0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:30.311471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4afec-1206-4fdb-8e8c-cd7d26d905ba None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.312114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4afec-1206-4fdb-8e8c-cd7d26d905ba None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.312618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4afec-1206-4fdb-8e8c-cd7d26d905ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.334806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5ba4afec-1206-4fdb-8e8c-cd7d26d905ba None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:30.336364 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5ba4afec-1206-4fdb-8e8c-cd7d26d905ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:30.440108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1354/2697] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:30.441990 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb013-08f1-49bd-98c0-22a610f8998b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.442280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb013-08f1-49bd-98c0-22a610f8998b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.442552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb013-08f1-49bd-98c0-22a610f8998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.476739 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-68bcb013-08f1-49bd-98c0-22a610f8998b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:30.478110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-68bcb013-08f1-49bd-98c0-22a610f8998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:30.488087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1344/2698] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:30.492671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4afec-1206-4fdb-8e8c-cd7d26d905ba None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:30.512564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4afec-1206-4fdb-8e8c-cd7d26d905ba None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:30.522425 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:30.523109 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.523447 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.523732 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.524472 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:52:30.525354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:30.529256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:30.552029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1355/2699] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:52:30.553190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcb013-08f1-49bd-98c0-22a610f8998b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:30.566844 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcb013-08f1-49bd-98c0-22a610f8998b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:30.577895 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:30.578677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.579030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.579381 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.580219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:30.582745 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:30.633177 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1345/2700] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:30 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:30.638095 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:30.648758 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9077d28-7d40-4f80-91bb-b9334bab089a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:30.717617 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:30.718336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.719515 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.719939 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.720557 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:30.723489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:30.747564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1356/2701] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:30 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:30.751667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:30.786862 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3651f4-bffb-4f92-b9c2-b283f2b68f7e admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:30.791882 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:30.792780 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.793132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.793463 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.794375 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:30.796048 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:30.808747 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1346/2702] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:30.812804 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:30.825007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617216bd-dee0-49dd-9dd5-5a8d199aa0d6 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:30.831525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a69a9-f498-4b6b-86ff-efaaa65b2448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:30.832561 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a69a9-f498-4b6b-86ff-efaaa65b2448 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.833049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a69a9-f498-4b6b-86ff-efaaa65b2448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.833976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a69a9-f498-4b6b-86ff-efaaa65b2448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.834992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a69a9-f498-4b6b-86ff-efaaa65b2448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:30.836965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a69a9-f498-4b6b-86ff-efaaa65b2448 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:30.848551 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1357/2703] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:52:30.852644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:30.868924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b45a-4e91-4b2a-8aaa-acecdc5a3eec admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:30.885915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:30.885915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.885915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.885915 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] PATH_INFO: `/v3/projects/9ebb1b6cf4bc4c809a8ca2afdf37068a/users/2e1137308d6f434282a3cf6dce7c94a7/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.896613 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb1b6cf4bc4c809a8ca2afdf37068a, user_id=2e1137308d6f434282a3cf6dce7c94a7, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:30.899893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:30.916220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1347/2704] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:30 2022] PUT /identity/v3/projects/9ebb1b6cf4bc4c809a8ca2afdf37068a/users/2e1137308d6f434282a3cf6dce7c94a7/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:30.927311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a236b-4bf3-4fd5-9912-c87580c3c94e None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:30.927602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a236b-4bf3-4fd5-9912-c87580c3c94e None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:30.927900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a236b-4bf3-4fd5-9912-c87580c3c94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:30.966383 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-995a236b-4bf3-4fd5-9912-c87580c3c94e None None] MFA Rules not processed for user `2e1137308d6f434282a3cf6dce7c94a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:30.967975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-995a236b-4bf3-4fd5-9912-c87580c3c94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:31.082118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1358/2705] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:31.092494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:31.094496 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:31.200782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7bfd5-7ae0-4e1d-8f73-89bbbcb641c1 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:31.207283 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9597d9-2afc-4ebf-a846-c13ff22732b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:31.207889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9597d9-2afc-4ebf-a846-c13ff22732b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:31.208180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9597d9-2afc-4ebf-a846-c13ff22732b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:31.208468 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9597d9-2afc-4ebf-a846-c13ff22732b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:31.218411 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9597d9-2afc-4ebf-a846-c13ff22732b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:31.219865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9597d9-2afc-4ebf-a846-c13ff22732b8 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:31.234139 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1348/2706] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:31.257802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a236b-4bf3-4fd5-9912-c87580c3c94e None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:31.346404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a236b-4bf3-4fd5-9912-c87580c3c94e None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:31.351574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:31.351968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:31.352248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:31.352521 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] PATH_INFO: `/v3/users/2e1137308d6f434282a3cf6dce7c94a7` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:31.355091 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1137308d6f434282a3cf6dce7c94a7)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:31.357193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:31.409925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1137308d6f434282a3cf6dce7c94a7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:31.417966 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1137308d6f434282a3cf6dce7c94a7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:31.418669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1137308d6f434282a3cf6dce7c94a7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:31.434007 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1137308d6f434282a3cf6dce7c94a7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:31.435022 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1137308d6f434282a3cf6dce7c94a7'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:31.447386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1359/2707] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:31 2022] DELETE /identity/v3/users/2e1137308d6f434282a3cf6dce7c94a7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:31.454497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:31.454953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:31.455302 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:31.474059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:31.475344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:31.551537 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1349/2708] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:31.562286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:31.563744 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:31.625573 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552e3b6-a924-4000-813e-ee8f05629b63 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:31.629347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0655470-5716-4ce3-b0c9-9c5eea65cc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:31.630136 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655470-5716-4ce3-b0c9-9c5eea65cc18 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:31.630422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655470-5716-4ce3-b0c9-9c5eea65cc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:31.630877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655470-5716-4ce3-b0c9-9c5eea65cc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:31.640715 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0655470-5716-4ce3-b0c9-9c5eea65cc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:31.642757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0655470-5716-4ce3-b0c9-9c5eea65cc18 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:31.653740 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1360/2709] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:31.996532 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:31.998608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:32.023307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998373f0-d11e-44e7-9ba2-3677daa43f9b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.038606 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.039901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.040266 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.040683 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] PATH_INFO: `/v3/projects/9ebb1b6cf4bc4c809a8ca2afdf37068a` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.042999 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebb1b6cf4bc4c809a8ca2afdf37068a)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.045365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.107414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebb1b6cf4bc4c809a8ca2afdf37068a', 'request_id': 'req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:32.115387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebb1b6cf4bc4c809a8ca2afdf37068a', 'request_id': 'req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:32.122442 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebb1b6cf4bc4c809a8ca2afdf37068a', 'request_id': 'req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:32.133962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] The token cache is being invalidate because project 9ebb1b6cf4bc4c809a8ca2afdf37068a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:32.134409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:32.135755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-2e4acf6e-a8fe-4cd4-ac40-f81e98ff0e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:32.138076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1350/2710] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:31 2022] DELETE /identity/v3/projects/9ebb1b6cf4bc4c809a8ca2afdf37068a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:32.142950 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ae27b-54fe-453c-9cee-5c3142131938 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.143678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ae27b-54fe-453c-9cee-5c3142131938 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.143678 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ae27b-54fe-453c-9cee-5c3142131938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.169125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d89ae27b-54fe-453c-9cee-5c3142131938 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:32.170632 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d89ae27b-54fe-453c-9cee-5c3142131938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:32.232238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1361/2711] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:32.239860 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683a18-f3f9-4fbc-ad8c-1d9936566336 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.240359 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683a18-f3f9-4fbc-ad8c-1d9936566336 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.240473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683a18-f3f9-4fbc-ad8c-1d9936566336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.262756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-63683a18-f3f9-4fbc-ad8c-1d9936566336 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:32.264409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-63683a18-f3f9-4fbc-ad8c-1d9936566336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:32.277262 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ae27b-54fe-453c-9cee-5c3142131938 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:32.279708 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1351/2712] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:32.287993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ae27b-54fe-453c-9cee-5c3142131938 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.293666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.294374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.294652 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.294924 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.295969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:52:32.295969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.297574 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.311341 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1362/2713] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:52:32.315981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683a18-f3f9-4fbc-ad8c-1d9936566336 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:32.326476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683a18-f3f9-4fbc-ad8c-1d9936566336 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.331344 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.332058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.332342 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.332615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.333312 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.335497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.365057 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1352/2714] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:32 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:32.366240 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:32.377216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e07e1-cd51-4563-96e3-9d0c14dfe327 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.438502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.438502 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.438751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.438849 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.439513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.441478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.465286 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1363/2715] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:32 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:52:32.469324 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:32.479889 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc991fcb-bdcb-4d7d-96c2-abe2b5362bc8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.484495 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.485144 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.485443 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.485716 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.486447 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.488063 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.499552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1353/2716] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:32.502858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:32.513221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d36be-9aab-4b4b-ac4d-618808355d59 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.517828 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1059-a6d1-4612-bf2f-d0e03020e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.518486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1059-a6d1-4612-bf2f-d0e03020e59d admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.518766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1059-a6d1-4612-bf2f-d0e03020e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.519043 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1059-a6d1-4612-bf2f-d0e03020e59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.519766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e1059-a6d1-4612-bf2f-d0e03020e59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.521366 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e1059-a6d1-4612-bf2f-d0e03020e59d admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.531881 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1364/2717] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:52:32.536187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:32.546908 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152723-c74d-4d72-b9e3-0b3ca50e89b1 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.552039 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.553086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.553501 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.553903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] PATH_INFO: `/v3/projects/9985bac8fcc14e4789563d1607c53e1f/users/11f6c22e34404f34a0da3d0e6da0e90b/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.570206 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9985bac8fcc14e4789563d1607c53e1f, user_id=11f6c22e34404f34a0da3d0e6da0e90b, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.572982 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.586571 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1354/2718] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:32 2022] PUT /identity/v3/projects/9985bac8fcc14e4789563d1607c53e1f/users/11f6c22e34404f34a0da3d0e6da0e90b/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:32.597034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bec8f-1652-406a-869b-049e4b77f4f2 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.597323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bec8f-1652-406a-869b-049e4b77f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.597598 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bec8f-1652-406a-869b-049e4b77f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.624974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-1a2bec8f-1652-406a-869b-049e4b77f4f2 None None] MFA Rules not processed for user `11f6c22e34404f34a0da3d0e6da0e90b`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:32.626179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-1a2bec8f-1652-406a-869b-049e4b77f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:32.689980 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1365/2719] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:32.700856 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:32.703473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:32.762913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778b8aa-a988-4c1d-a9bc-680da8794a22 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:32.766629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f484a-6aca-4b5e-91f6-1ec22a2868a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:32.767348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f484a-6aca-4b5e-91f6-1ec22a2868a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:32.767629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f484a-6aca-4b5e-91f6-1ec22a2868a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:32.767899 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f484a-6aca-4b5e-91f6-1ec22a2868a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:32.778134 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f484a-6aca-4b5e-91f6-1ec22a2868a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:32.779826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f484a-6aca-4b5e-91f6-1ec22a2868a7 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:32.790257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1355/2720] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:40.235940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bec8f-1652-406a-869b-049e4b77f4f2 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:40.297032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bec8f-1652-406a-869b-049e4b77f4f2 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:40.301596 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:40.302498 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:40.302783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:40.303057 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] PATH_INFO: `/v3/users/11f6c22e34404f34a0da3d0e6da0e90b` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:40.304243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f6c22e34404f34a0da3d0e6da0e90b)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:40.306206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:40.352228 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f6c22e34404f34a0da3d0e6da0e90b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:40.359409 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f6c22e34404f34a0da3d0e6da0e90b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:40.360040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f6c22e34404f34a0da3d0e6da0e90b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:40.373187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f6c22e34404f34a0da3d0e6da0e90b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:40.373931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f6c22e34404f34a0da3d0e6da0e90b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:40.388834 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1366/2721] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:40 2022] DELETE /identity/v3/users/11f6c22e34404f34a0da3d0e6da0e90b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:40.393439 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:40.393931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:40.394183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:40.411885 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:40.413084 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:40.482969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1356/2722] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:40.492886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:40.494404 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:40.558313 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff278d8-f7ec-4cc4-90d8-4af38d457fba admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:40.562133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184388ae-ac1a-40e1-bf45-d82983d1633d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:40.562789 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184388ae-ac1a-40e1-bf45-d82983d1633d service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:40.563072 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184388ae-ac1a-40e1-bf45-d82983d1633d service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:40.563347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184388ae-ac1a-40e1-bf45-d82983d1633d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:40.573187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184388ae-ac1a-40e1-bf45-d82983d1633d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:40.574780 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184388ae-ac1a-40e1-bf45-d82983d1633d service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:40.585343 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1367/2723] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:40.918962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:40.920414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:40.932180 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e489-c786-4ce6-9ba7-a85b3a652e78 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:40.936821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:40.937682 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:40.937991 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:40.938269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] PATH_INFO: `/v3/projects/9985bac8fcc14e4789563d1607c53e1f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:40.939462 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9985bac8fcc14e4789563d1607c53e1f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:40.941370 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:40.987612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9985bac8fcc14e4789563d1607c53e1f', 'request_id': 'req-53752e9a-5e21-4bbc-9737-f852bd39ef4b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:40.994410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9985bac8fcc14e4789563d1607c53e1f', 'request_id': 'req-53752e9a-5e21-4bbc-9737-f852bd39ef4b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:41.000362 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9985bac8fcc14e4789563d1607c53e1f', 'request_id': 'req-53752e9a-5e21-4bbc-9737-f852bd39ef4b'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:41.010702 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] The token cache is being invalidate because project 9985bac8fcc14e4789563d1607c53e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:41.010986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:41.011603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-53752e9a-5e21-4bbc-9737-f852bd39ef4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:41.013172 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1357/2724] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:40 2022] DELETE /identity/v3/projects/9985bac8fcc14e4789563d1607c53e1f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:41.017895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea9d05-4bac-42fe-9a8b-803a148ee5d5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.018186 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea9d05-4bac-42fe-9a8b-803a148ee5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.018461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea9d05-4bac-42fe-9a8b-803a148ee5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.037774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-c0ea9d05-4bac-42fe-9a8b-803a148ee5d5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:41.038976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c0ea9d05-4bac-42fe-9a8b-803a148ee5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:41.095018 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1368/2725] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:41.103922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987ba9-00ad-444e-8ce6-e3c008085e6c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.104210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987ba9-00ad-444e-8ce6-e3c008085e6c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.104486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987ba9-00ad-444e-8ce6-e3c008085e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.122296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-4c987ba9-00ad-444e-8ce6-e3c008085e6c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:41.123504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4c987ba9-00ad-444e-8ce6-e3c008085e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:41.131409 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1358/2726] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:41.136066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea9d05-4bac-42fe-9a8b-803a148ee5d5 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:41.145440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea9d05-4bac-42fe-9a8b-803a148ee5d5 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:41.150034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:41.150675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.151576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.151852 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.152576 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:52:41.152883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:41.154536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:41.165542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1369/2727] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:52:41.169523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c987ba9-00ad-444e-8ce6-e3c008085e6c None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:41.178477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c987ba9-00ad-444e-8ce6-e3c008085e6c None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:41.183548 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:41.184178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.184461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.184735 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.185461 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:41.187455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:41.212270 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1359/2728] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:52:41 2022] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:52:41.216317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:41.225919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ff9b7-8a2a-4bcd-9e2b-ae5e6eb58efa admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:41.278915 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:41.279588 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.279837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.280110 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.280794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:41.282757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:41.301783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1370/2729] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:52:41 2022] POST /identity/v3/users => generated 300 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:52:41.305869 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:41.316473 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6173fc6-e35e-42a5-8fcd-5bbe3e37e5c2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:41.321117 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:41.321791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.322078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.322355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.323699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:41.325292 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:41.335565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1360/2730] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:52:41.339094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:41.348482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba01fb-5330-4a21-b01f-3df8fce12849 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:41.353114 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b224b8-e016-4c5f-beaa-7b471b07dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:41.353782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b224b8-e016-4c5f-beaa-7b471b07dd34 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.354076 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b224b8-e016-4c5f-beaa-7b471b07dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.354358 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b224b8-e016-4c5f-beaa-7b471b07dd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.355074 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b224b8-e016-4c5f-beaa-7b471b07dd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:41.356663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b224b8-e016-4c5f-beaa-7b471b07dd34 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:41.366122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1371/2731] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:52:41.370415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:41.379955 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627076-d468-4af8-97bb-3f13e4511ad1 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:41.384509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:41.385954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.386240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.386516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] PATH_INFO: `/v3/projects/073864ff758846a6b8b5343cfcb77a67/users/17d205dcc81f46e1a9e9310fe4069505/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.402297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=073864ff758846a6b8b5343cfcb77a67, user_id=17d205dcc81f46e1a9e9310fe4069505, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:41.405028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:41.418543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1361/2732] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:52:41 2022] PUT /identity/v3/projects/073864ff758846a6b8b5343cfcb77a67/users/17d205dcc81f46e1a9e9310fe4069505/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:41.428587 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d784c08-7da6-4f0d-abf7-af36b47ff00a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.428954 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d784c08-7da6-4f0d-abf7-af36b47ff00a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.429340 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d784c08-7da6-4f0d-abf7-af36b47ff00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.457905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-6d784c08-7da6-4f0d-abf7-af36b47ff00a None None] MFA Rules not processed for user `17d205dcc81f46e1a9e9310fe4069505`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:41.459387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-6d784c08-7da6-4f0d-abf7-af36b47ff00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:41.535094 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1372/2733] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:41.546770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:41.548549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:41.604551 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3d00-8e4a-4b3e-b05a-6cebf3543d9a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:41.608194 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449153f-cabc-4cfa-8a62-7b9376457329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:41.608827 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449153f-cabc-4cfa-8a62-7b9376457329 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:41.609108 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449153f-cabc-4cfa-8a62-7b9376457329 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:41.609379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449153f-cabc-4cfa-8a62-7b9376457329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:41.617507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449153f-cabc-4cfa-8a62-7b9376457329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:41.618968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449153f-cabc-4cfa-8a62-7b9376457329 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:41.628285 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1362/2734] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:48.613437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d784c08-7da6-4f0d-abf7-af36b47ff00a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:48.672082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d784c08-7da6-4f0d-abf7-af36b47ff00a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:48.676480 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:48.677327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:48.677607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:48.677927 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] PATH_INFO: `/v3/users/17d205dcc81f46e1a9e9310fe4069505` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:48.679093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d205dcc81f46e1a9e9310fe4069505)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:48.681015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:48.726026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d205dcc81f46e1a9e9310fe4069505'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:48.733779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d205dcc81f46e1a9e9310fe4069505'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:48.734393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d205dcc81f46e1a9e9310fe4069505'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:48.745504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d205dcc81f46e1a9e9310fe4069505'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:48.746149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d205dcc81f46e1a9e9310fe4069505'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:48.758277 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1373/2735] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:52:48 2022] DELETE /identity/v3/users/17d205dcc81f46e1a9e9310fe4069505 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:52:48.763385 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:48.763865 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:48.763969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:48.780699 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:52:48.781931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:48.839470 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1363/2736] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:52:48.849221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:48.850716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:48.905479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fdc6c-193c-49c1-b3ca-8d6cfaf18c78 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:48.909282 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:48.909968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:48.910261 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:48.910533 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:48.919353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:48.920821 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:48.929944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1374/2737] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:52:49.196586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:52:49.198260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:52:49.211809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66223ea-dbbc-46d9-9a2c-416db3b2ebe7 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:52:49.216404 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:52:49.217256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:52:49.217531 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:52:49.217836 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] PATH_INFO: `/v3/projects/073864ff758846a6b8b5343cfcb77a67` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:52:49.219022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073864ff758846a6b8b5343cfcb77a67)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:52:49.220919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:52:49.266181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073864ff758846a6b8b5343cfcb77a67', 'request_id': 'req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:49.273133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073864ff758846a6b8b5343cfcb77a67', 'request_id': 'req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:49.279171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073864ff758846a6b8b5343cfcb77a67', 'request_id': 'req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:49.289368 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] The token cache is being invalidate because project 073864ff758846a6b8b5343cfcb77a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:52:49.289657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:49.290317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:52:49.291855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1364/2738] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:52:49 2022] DELETE /identity/v3/projects/073864ff758846a6b8b5343cfcb77a67 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:53:05.996675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:53:05.998129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:53:06.067972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22ffb-9a96-4f03-bbae-9d1cc73e62b1 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:53:06.133146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:53:06.133871 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:53:06.134158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:53:06.134437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:53:06.136289 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:53:06.150050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:53:06.151669 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:53:06.163437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1375/2739] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:53:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:53:07.506080 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:53:07.507547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:53:07.563254 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f83b30-419c-4c01-8fb1-8e1f3aac5d18 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:53:07.566855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063d24-4d41-4a79-9c91-699dbe2c6d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:53:07.567430 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063d24-4d41-4a79-9c91-699dbe2c6d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:53:07.567711 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063d24-4d41-4a79-9c91-699dbe2c6d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:53:07.569959 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063d24-4d41-4a79-9c91-699dbe2c6d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:53:07.571813 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ef063d24-4d41-4a79-9c91-699dbe2c6d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:53:07.581522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063d24-4d41-4a79-9c91-699dbe2c6d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:53:07.582989 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063d24-4d41-4a79-9c91-699dbe2c6d23 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:53:07.592278 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1365/2740] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:53:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:53:07.664012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:53:07.665464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:53:07.678177 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ba354-8077-46a1-9b4a-10633951208d service placement] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:53:07.681889 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffcf04-cf41-4d06-a53b-92c9ff0dc88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:53:07.682528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcf04-cf41-4d06-a53b-92c9ff0dc88d service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:53:07.682811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcf04-cf41-4d06-a53b-92c9ff0dc88d service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:53:07.683119 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcf04-cf41-4d06-a53b-92c9ff0dc88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:53:07.684890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-38ffcf04-cf41-4d06-a53b-92c9ff0dc88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:53:07.752794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffcf04-cf41-4d06-a53b-92c9ff0dc88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:53:07.754276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffcf04-cf41-4d06-a53b-92c9ff0dc88d service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:53:07.765458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1376/2741] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:53:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:53:29.938110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:53:29.938641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:53:29.938641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:53:29.956775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] MFA Rules not processed for user `61fcd9d503734952b0ea9ec6ef96be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:53:29.958007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:53:30.009893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1366/2742] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:53:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:54:29.480579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec78d2-8583-4fa8-822e-c160616886ca None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:29.481105 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec78d2-8583-4fa8-822e-c160616886ca None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:29.481206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec78d2-8583-4fa8-822e-c160616886ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:29.499444 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-57ec78d2-8583-4fa8-822e-c160616886ca None None] MFA Rules not processed for user `61fcd9d503734952b0ea9ec6ef96be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:54:29.500752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-57ec78d2-8583-4fa8-822e-c160616886ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:29.507820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1377/2743] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:54:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:54:45.755075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:45.756632 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:45.824019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6fb1-d40e-4580-a3b8-2047846c2893 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:45.829146 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:45.830058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:45.830341 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:45.830625 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] PATH_INFO: `/v3/users/7f6da611aff04192a59cd39f3b2d6cb6` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:45.831821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6da611aff04192a59cd39f3b2d6cb6)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:45.833763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:45.877880 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6da611aff04192a59cd39f3b2d6cb6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:45.884407 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6da611aff04192a59cd39f3b2d6cb6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:45.885067 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6da611aff04192a59cd39f3b2d6cb6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:45.896835 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6da611aff04192a59cd39f3b2d6cb6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:45.897459 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6da611aff04192a59cd39f3b2d6cb6'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:45.909954 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1367/2744] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:54:45 2022] DELETE /identity/v3/users/7f6da611aff04192a59cd39f3b2d6cb6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:54:46.079099 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec78d2-8583-4fa8-822e-c160616886ca None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:46.091885 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec78d2-8583-4fa8-822e-c160616886ca None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:46.147618 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:46.148471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.148753 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.149031 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] PATH_INFO: `/v3/projects/cde372d003ca4f5fbafa9d6a4bc52e3e` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.150238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde372d003ca4f5fbafa9d6a4bc52e3e)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:46.152176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:46.196944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'request_id': 'req-32bd9c62-83b4-4975-8c3e-02922698b5c0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.204248 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'request_id': 'req-32bd9c62-83b4-4975-8c3e-02922698b5c0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.210948 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'request_id': 'req-32bd9c62-83b4-4975-8c3e-02922698b5c0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.221032 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] The token cache is being invalidate because project cde372d003ca4f5fbafa9d6a4bc52e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:54:46.221324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.221976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.223503 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1378/2745] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:54:46 2022] DELETE /identity/v3/projects/cde372d003ca4f5fbafa9d6a4bc52e3e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:54:46.227664 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:46.229062 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:46.242343 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e1529-d648-403e-a7f5-e8b0231189a9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:46.295011 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:46.295793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.296594 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.296890 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] PATH_INFO: `/v3/users/a76ee8849fb34c959a841cca0d863123` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.298149 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76ee8849fb34c959a841cca0d863123)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:46.300053 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:46.343960 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76ee8849fb34c959a841cca0d863123'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.350569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76ee8849fb34c959a841cca0d863123'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.351207 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76ee8849fb34c959a841cca0d863123'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.362760 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76ee8849fb34c959a841cca0d863123'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.363405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-c0c2c9c1-abe5-45df-bdd1-c0aa8f79b7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76ee8849fb34c959a841cca0d863123'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.375445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1368/2746] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:54:46 2022] DELETE /identity/v3/users/a76ee8849fb34c959a841cca0d863123 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:54:46.545156 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:46.546595 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:46.560684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c62-83b4-4975-8c3e-02922698b5c0 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:46.617350 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:46.618284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.618563 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.618837 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] PATH_INFO: `/v3/projects/0530226851c04ebcb6760a2c1bfe606f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.620015 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0530226851c04ebcb6760a2c1bfe606f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:46.621967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:46.667930 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0530226851c04ebcb6760a2c1bfe606f', 'request_id': 'req-87b020fc-5df7-480d-9c5c-ac549d20588b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.674782 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0530226851c04ebcb6760a2c1bfe606f', 'request_id': 'req-87b020fc-5df7-480d-9c5c-ac549d20588b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.680812 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0530226851c04ebcb6760a2c1bfe606f', 'request_id': 'req-87b020fc-5df7-480d-9c5c-ac549d20588b'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.691287 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] The token cache is being invalidate because project 0530226851c04ebcb6760a2c1bfe606f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:54:46.691592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.692221 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-87b020fc-5df7-480d-9c5c-ac549d20588b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:54:46.693766 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1379/2747] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:54:46 2022] DELETE /identity/v3/projects/0530226851c04ebcb6760a2c1bfe606f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:54:46.698678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6eac9-d14c-43a3-b8c2-6c6cef3fc208 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.698974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6eac9-d14c-43a3-b8c2-6c6cef3fc208 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.699251 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6eac9-d14c-43a3-b8c2-6c6cef3fc208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.717509 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-24c6eac9-d14c-43a3-b8c2-6c6cef3fc208 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:54:46.718740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-24c6eac9-d14c-43a3-b8c2-6c6cef3fc208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:46.775528 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1369/2748] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:54:46.783962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90dd1f-4261-44c0-836a-ea9ab6e478b8 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.784255 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90dd1f-4261-44c0-836a-ea9ab6e478b8 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.784536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90dd1f-4261-44c0-836a-ea9ab6e478b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.802760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-5d90dd1f-4261-44c0-836a-ea9ab6e478b8 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:54:46.803879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-5d90dd1f-4261-44c0-836a-ea9ab6e478b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:46.812486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1380/2749] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:54:46.816451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6eac9-d14c-43a3-b8c2-6c6cef3fc208 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:46.825816 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6eac9-d14c-43a3-b8c2-6c6cef3fc208 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:46.830234 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:46.830867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.831145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.831418 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.832132 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:54:46.832438 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:46.834098 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:46.845357 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1370/2750] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:54:46.849471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90dd1f-4261-44c0-836a-ea9ab6e478b8 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:46.859064 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90dd1f-4261-44c0-836a-ea9ab6e478b8 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:46.863661 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:46.864296 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.864584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.864865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.865559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:46.867508 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:46.892688 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1381/2751] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:54:46 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:54:46.896648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:46.906260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0368c-8a30-41a1-8ba9-7a3d0809985d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:46.961054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:46.961724 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:46.962020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:46.962303 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:46.962994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:46.965173 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:46.985917 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1371/2752] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:54:46 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:54:46.989912 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:47.000723 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bb66-84fe-4454-bec5-77fa6d90ddf4 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:47.005453 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:47.006146 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:47.006433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:47.006727 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:47.007436 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:47.009081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:47.019334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1382/2753] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:54:47.023197 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:47.032840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f0e39-b382-4241-bc09-ae18809e54a8 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:47.038398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884b87c-9dde-471f-b4f9-c758a1cc33c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:47.040263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b87c-9dde-471f-b4f9-c758a1cc33c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:47.040263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b87c-9dde-471f-b4f9-c758a1cc33c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:47.040263 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b87c-9dde-471f-b4f9-c758a1cc33c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:47.040685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884b87c-9dde-471f-b4f9-c758a1cc33c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:47.042118 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884b87c-9dde-471f-b4f9-c758a1cc33c5 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:47.062454 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1372/2754] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:54:47.062635 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:47.071592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0c99-ca38-417c-93d8-7af8e6c2aa0b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:47.077372 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:47.079006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:47.079525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:47.080087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] PATH_INFO: `/v3/projects/7d148f892d044444b6be65537ba8b335/users/f6b3ad012ab1404b88e4b36c80a02a05/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:47.098767 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d148f892d044444b6be65537ba8b335, user_id=f6b3ad012ab1404b88e4b36c80a02a05, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:47.101523 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:47.115068 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1383/2755] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:54:47 2022] PUT /identity/v3/projects/7d148f892d044444b6be65537ba8b335/users/f6b3ad012ab1404b88e4b36c80a02a05/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:54:47.120424 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657f588-31f6-499a-8a15-dface546fa2c None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:47.120714 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657f588-31f6-499a-8a15-dface546fa2c None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:47.121019 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657f588-31f6-499a-8a15-dface546fa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:47.138621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-3657f588-31f6-499a-8a15-dface546fa2c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:54:47.140662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-3657f588-31f6-499a-8a15-dface546fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:47.199599 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1373/2756] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:54:47.209139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:47.210963 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:47.265928 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66130-bb14-4229-878c-1711c39dcf13 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:47.269522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:47.270193 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:47.270478 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:47.270752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:47.279534 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:47.281486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:47.290696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1384/2757] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:54:51.258779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8793-189b-474d-addc-85e836f0c4e7 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:51.259773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8793-189b-474d-addc-85e836f0c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:51.260214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8793-189b-474d-addc-85e836f0c4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:51.290171 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7aec8793-189b-474d-addc-85e836f0c4e7 None None] MFA Rules not processed for user `f6b3ad012ab1404b88e4b36c80a02a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:54:51.291514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7aec8793-189b-474d-addc-85e836f0c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:51.365518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1374/2758] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:54:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:54:51.370323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:51.381332 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d5fd-52e0-4875-bc4b-9f78bd70caf6 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:51.386526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:51.387418 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:51.387877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:51.388323 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:51.389353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:51.391553 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:51.422838 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1385/2759] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:54:51 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:54:51.427406 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec8793-189b-474d-addc-85e836f0c4e7 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:51.439529 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec8793-189b-474d-addc-85e836f0c4e7 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:51.500812 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:51.501662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:51.502076 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:51.502421 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:51.503187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:51.505252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:51.527168 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1375/2760] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:54:51 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:54:51.531050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:51.541738 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c5e9a-821d-4035-8089-f2534e7a76c7 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:51.547509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:51.548176 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:51.548456 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:51.548731 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:51.549461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:51.551181 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:51.562974 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1386/2761] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:54:51.567284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:51.579162 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f886e-4beb-4bf0-a5ab-f63d9212f0c0 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:51.597355 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:51.599111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:51.599652 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:51.599801 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] PATH_INFO: `/v3/projects/67ec3f77ca454ea2a27dcdec90ebc859/users/3543d74e520d4d018c4c55b9f9bef7a7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:51.619622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ec3f77ca454ea2a27dcdec90ebc859, user_id=3543d74e520d4d018c4c55b9f9bef7a7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:51.625096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:51.641516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1376/2762] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:54:51 2022] PUT /identity/v3/projects/67ec3f77ca454ea2a27dcdec90ebc859/users/3543d74e520d4d018c4c55b9f9bef7a7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:54:51.645591 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:51.656445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765606df-6b5e-4980-9cb0-02eb50592929 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:51.717360 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397135c-0c5c-4c98-b6cb-ffdde5140b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:51.718088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397135c-0c5c-4c98-b6cb-ffdde5140b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:51.718310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397135c-0c5c-4c98-b6cb-ffdde5140b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:51.718584 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397135c-0c5c-4c98-b6cb-ffdde5140b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:51.719317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397135c-0c5c-4c98-b6cb-ffdde5140b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:51.720929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397135c-0c5c-4c98-b6cb-ffdde5140b42 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:51.731437 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1387/2763] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:54:51.735778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:51.747038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36c13-8f17-41b2-a5f0-cd673cbe5655 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:51.752246 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:51.753128 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:51.753410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:51.753688 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] PATH_INFO: `/v3/projects/67ec3f77ca454ea2a27dcdec90ebc859/users/3543d74e520d4d018c4c55b9f9bef7a7/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:51.755706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ec3f77ca454ea2a27dcdec90ebc859, user_id=3543d74e520d4d018c4c55b9f9bef7a7, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:51.758433 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:51.769659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1377/2764] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:54:51 2022] PUT /identity/v3/projects/67ec3f77ca454ea2a27dcdec90ebc859/users/3543d74e520d4d018c4c55b9f9bef7a7/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:54:56.595448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bbca5-4b39-4a11-998f-4d31ac78ed03 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:56.595953 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bbca5-4b39-4a11-998f-4d31ac78ed03 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:56.596066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bbca5-4b39-4a11-998f-4d31ac78ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:56.628941 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a46bbca5-4b39-4a11-998f-4d31ac78ed03 None None] MFA Rules not processed for user `3543d74e520d4d018c4c55b9f9bef7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:54:56.630209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a46bbca5-4b39-4a11-998f-4d31ac78ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:56.699687 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1388/2765] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:54:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:54:56.714119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:54:56.716153 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:54:56.788276 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e9df1-c189-4aca-bdbb-8b560e3d8a6a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:54:56.794160 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:54:56.794839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:54:56.795121 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:54:56.795398 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:54:56.849894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:54:56.851483 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:54:56.860199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1378/2766] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:54:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:13.006581 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:13.007152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:13.007152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:13.024058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] MFA Rules not processed for user `f6b3ad012ab1404b88e4b36c80a02a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:55:13.025232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:13.031960 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1389/2767] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:55:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:55:13.068360 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:13.069755 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:13.123597 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9d06-34ba-47c4-a876-0169d2670cbf service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:13.127667 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:13.128297 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:13.128580 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:13.128858 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:13.130636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:13.143514 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:13.144961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:13.155832 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1379/2768] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:13.433179 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:13.434615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:13.491208 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3f104-207b-4254-b1cd-9965db2d7b05 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:13.494844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:13.495487 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:13.495770 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:13.496048 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:13.497893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:13.508081 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:13.509518 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:13.518002 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1390/2769] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:13.962970 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:13.972415 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3399a1-06d2-4012-a796-759521675dcb service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:13.976262 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:13.976965 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:13.977325 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:13.977670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:13.979560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:13.994618 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:13.996038 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:14.007929 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1380/2770] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:27.683334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:27.692334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5346883-366b-441a-a3fd-fea4768369a0 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:27.695943 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb4ff2-0de0-4249-bc12-af11a624ee61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:27.696572 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4ff2-0de0-4249-bc12-af11a624ee61 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:27.696855 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4ff2-0de0-4249-bc12-af11a624ee61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:27.697132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4ff2-0de0-4249-bc12-af11a624ee61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:27.698893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-60bb4ff2-0de0-4249-bc12-af11a624ee61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:27.710459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb4ff2-0de0-4249-bc12-af11a624ee61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:27.711962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb4ff2-0de0-4249-bc12-af11a624ee61 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:27.722814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1391/2771] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:29.351372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:29.359775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ac926-d29b-4160-93e2-867f714ad803 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:29.363356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:29.363976 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:29.364259 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:29.364535 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:29.373138 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:29.374591 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:29.384340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1381/2772] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:36.082270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:36.082803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:36.083029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:36.100434 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] MFA Rules not processed for user `61fcd9d503734952b0ea9ec6ef96be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:55:36.101623 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:36.155760 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1392/2773] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:55:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:55:36.737086 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:36.738626 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:36.806593 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf2b5c-f116-4cd0-a3a0-d2315f8b5286 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:36.811530 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:36.812203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:36.812486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:36.812761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:36.815040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:36.826210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:36.827775 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:36.838256 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1382/2774] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:45.402558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:45.403989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:45.421728 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13846-e6c1-40a6-85d4-7cb683db530a None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:45.427440 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:45.428087 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:45.428370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:45.428648 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:45.430449 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:45.442801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:45.444381 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:45.456006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1393/2775] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:55:49.510588 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:55:49.522603 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62a57-e6c3-4458-81c0-537d1d41894c service placement] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:55:49.528281 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:55:49.528911 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:55:49.529193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:55:49.529471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:55:49.531288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:55:49.544034 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:55:49.545622 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:55:49.556927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1383/2776] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:55:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:56:38.640034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:38.652655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134930-b5f1-4964-adb3-6d8cd9e68c23 service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:38.659269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:38.659921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:38.660204 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:38.660495 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:38.662417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:56:38.677445 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:38.679107 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:38.702666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1394/2777] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:56:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:56:46.787201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:46.788777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:56:46.854791 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21795818-e611-4822-bd30-15ec3c25719a service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:46.859345 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:46.860222 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:46.860498 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:46.860769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] PATH_INFO: `/v3/users/61fcd9d503734952b0ea9ec6ef96be6c` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:46.861992 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fcd9d503734952b0ea9ec6ef96be6c)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:46.863892 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:46.909306 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fcd9d503734952b0ea9ec6ef96be6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:46.916552 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fcd9d503734952b0ea9ec6ef96be6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:46.917212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fcd9d503734952b0ea9ec6ef96be6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:46.928494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fcd9d503734952b0ea9ec6ef96be6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:46.929120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-26e67d47-a03c-4669-bf5d-56f317d63cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fcd9d503734952b0ea9ec6ef96be6c'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:46.948006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1384/2778] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:56:46 2022] DELETE /identity/v3/users/61fcd9d503734952b0ea9ec6ef96be6c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:56:47.115455 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.126544 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e237c-2dfa-4600-9b39-cbe7bbe918df service nova] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.193603 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.194519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.194803 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.195082 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] PATH_INFO: `/v3/projects/b284fcbfe0214240a616a6d68cedfed2` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.196276 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b284fcbfe0214240a616a6d68cedfed2)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.198227 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.243752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b284fcbfe0214240a616a6d68cedfed2', 'request_id': 'req-28366fa0-2234-4d5d-bc77-89f8fc394be1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:47.251631 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b284fcbfe0214240a616a6d68cedfed2', 'request_id': 'req-28366fa0-2234-4d5d-bc77-89f8fc394be1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:47.258190 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b284fcbfe0214240a616a6d68cedfed2', 'request_id': 'req-28366fa0-2234-4d5d-bc77-89f8fc394be1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:47.267987 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] The token cache is being invalidate because project b284fcbfe0214240a616a6d68cedfed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:56:47.268275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:47.268910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-28366fa0-2234-4d5d-bc77-89f8fc394be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:56:47.271344 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1395/2779] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:56:47 2022] DELETE /identity/v3/projects/b284fcbfe0214240a616a6d68cedfed2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:56:47.276267 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58aef8-4346-4d07-a041-d1430599dcd7 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.276559 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58aef8-4346-4d07-a041-d1430599dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.276840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58aef8-4346-4d07-a041-d1430599dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.294937 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-6b58aef8-4346-4d07-a041-d1430599dcd7 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:56:47.296055 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6b58aef8-4346-4d07-a041-d1430599dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:56:47.352376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1385/2780] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:56:47.359982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef263e-928d-47ab-9142-91baa729d181 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.360270 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef263e-928d-47ab-9142-91baa729d181 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.360545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef263e-928d-47ab-9142-91baa729d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.377921 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-4cef263e-928d-47ab-9142-91baa729d181 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:56:47.379101 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-4cef263e-928d-47ab-9142-91baa729d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:56:47.387312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1396/2781] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:56:47.391240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58aef8-4346-4d07-a041-d1430599dcd7 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.401399 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58aef8-4346-4d07-a041-d1430599dcd7 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.405969 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.406609 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.406922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.407199 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.407921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:56:47.408229 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.409846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.420931 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1386/2782] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:56:47.425029 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef263e-928d-47ab-9142-91baa729d181 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.434394 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef263e-928d-47ab-9142-91baa729d181 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.438997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.439626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.439905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.440175 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.440850 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.443387 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.467822 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1397/2783] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:56:47 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:56:47.472330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.482075 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a278e-4c92-4507-8fef-fabd411b9aec admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.536934 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.537592 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.537901 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.538212 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.538918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.540823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.559893 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1387/2784] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:56:47 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:56:47.563916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.574431 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7446e-4dae-4bbd-8da5-ef6b4d54e90c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.579158 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.579809 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.580089 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.580386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.581125 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.582750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.593171 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1398/2785] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:56:47.597436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.607209 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539e62-bc67-4ea0-92d5-c05503df631d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.611804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62adb-708a-4857-813f-2302e341f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.612451 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62adb-708a-4857-813f-2302e341f379 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.612729 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62adb-708a-4857-813f-2302e341f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.613032 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62adb-708a-4857-813f-2302e341f379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.613770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb62adb-708a-4857-813f-2302e341f379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.615902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb62adb-708a-4857-813f-2302e341f379 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.625549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1388/2786] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:56:47.629873 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.640279 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38906-a24d-4f0a-8f61-5b1f40a12e7c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.645040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.646021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.646336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.646613 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] PATH_INFO: `/v3/projects/b0f5e16bf34e43848314de4c3bd26af6/users/e09166cc0dce4313a6fa0fba49fd09e9/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.660559 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f5e16bf34e43848314de4c3bd26af6, user_id=e09166cc0dce4313a6fa0fba49fd09e9, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.663251 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.677537 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1399/2787] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:56:47 2022] PUT /identity/v3/projects/b0f5e16bf34e43848314de4c3bd26af6/users/e09166cc0dce4313a6fa0fba49fd09e9/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:56:47.688252 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb7c4-b20c-45f4-a740-e2782f457c0b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.688572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb7c4-b20c-45f4-a740-e2782f457c0b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.688852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb7c4-b20c-45f4-a740-e2782f457c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.715115 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-622eb7c4-b20c-45f4-a740-e2782f457c0b None None] MFA Rules not processed for user `e09166cc0dce4313a6fa0fba49fd09e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:56:47.716309 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-622eb7c4-b20c-45f4-a740-e2782f457c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:56:47.777662 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1389/2788] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:56:47.782097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.842501 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194bf4f-68aa-4a0e-a492-90565ace96f8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.847290 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.847940 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.848218 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.848488 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.849737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.851636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.876321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1400/2789] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:56:47 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:56:47.880307 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb7c4-b20c-45f4-a740-e2782f457c0b None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.890487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb7c4-b20c-45f4-a740-e2782f457c0b None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.945059 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.945732 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.946022 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.946296 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.946981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.948938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:47.967703 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1390/2790] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:56:47 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:56:47.972034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:47.982536 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159679-a0e5-4180-8f61-15324f7f56ff admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:47.987132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:47.987773 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:47.988092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:47.988368 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:47.989084 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:47.991851 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:48.002187 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1401/2791] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:56:48.006290 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:48.015984 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b331-c68e-4066-8bb4-e7ba471dca29 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:48.020547 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:48.021402 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:48.021679 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:48.021985 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] PATH_INFO: `/v3/projects/597896feb15f4022a04020f81a046662/users/07c5eaedb5ec4fbd8a811d540ebfc539/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:48.036897 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597896feb15f4022a04020f81a046662, user_id=07c5eaedb5ec4fbd8a811d540ebfc539, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:48.039660 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:48.052656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1391/2792] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:56:48 2022] PUT /identity/v3/projects/597896feb15f4022a04020f81a046662/users/07c5eaedb5ec4fbd8a811d540ebfc539/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:56:48.056491 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:48.066607 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3b7f-5909-49c5-9625-ad137119b272 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:48.119872 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd8b7f-2406-456e-812f-b5a5632a38d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:48.120479 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd8b7f-2406-456e-812f-b5a5632a38d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:48.120720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd8b7f-2406-456e-812f-b5a5632a38d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:48.120989 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd8b7f-2406-456e-812f-b5a5632a38d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:48.121749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd8b7f-2406-456e-812f-b5a5632a38d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:48.123336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd8b7f-2406-456e-812f-b5a5632a38d2 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:48.132585 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1402/2793] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:56:48.136651 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:48.147205 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b5f6b-d663-44d4-90af-d2b1f5e81333 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:48.151744 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:48.152605 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:48.152886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:48.153159 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] PATH_INFO: `/v3/projects/597896feb15f4022a04020f81a046662/users/07c5eaedb5ec4fbd8a811d540ebfc539/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:48.155284 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597896feb15f4022a04020f81a046662, user_id=07c5eaedb5ec4fbd8a811d540ebfc539, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:48.157949 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:48.168560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1392/2794] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:56:48 2022] PUT /identity/v3/projects/597896feb15f4022a04020f81a046662/users/07c5eaedb5ec4fbd8a811d540ebfc539/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:56:48.178354 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420bb9-96ea-49a5-9e9f-389a150fe584 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:48.178665 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420bb9-96ea-49a5-9e9f-389a150fe584 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:48.178938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420bb9-96ea-49a5-9e9f-389a150fe584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:48.203692 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-84420bb9-96ea-49a5-9e9f-389a150fe584 None None] MFA Rules not processed for user `07c5eaedb5ec4fbd8a811d540ebfc539`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:56:48.204897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-84420bb9-96ea-49a5-9e9f-389a150fe584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:56:48.270219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1403/2795] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:56:48.281657 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:48.283541 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:56:48.338538 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d2bb-367f-4c8b-8bbe-409aeff4f326 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:48.342251 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:48.342884 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:48.343170 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:48.343445 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:48.353186 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:48.354678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:48.363840 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1393/2796] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:56:48.432830 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84420bb9-96ea-49a5-9e9f-389a150fe584 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:56:48.442334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84420bb9-96ea-49a5-9e9f-389a150fe584 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:56:48.446066 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359a643-6bc0-4e73-8dcd-6c058ccdbad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:56:48.446696 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a643-6bc0-4e73-8dcd-6c058ccdbad5 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:56:48.446982 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a643-6bc0-4e73-8dcd-6c058ccdbad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:56:48.447257 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a643-6bc0-4e73-8dcd-6c058ccdbad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:56:48.504123 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359a643-6bc0-4e73-8dcd-6c058ccdbad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:56:48.506115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359a643-6bc0-4e73-8dcd-6c058ccdbad5 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:56:48.515219 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1404/2797] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:26.431786 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:26.533823 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177195d-a592-438b-bb26-3df71384f538 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:26.538388 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:26.539245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:26.539527 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:26.539804 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] PATH_INFO: `/v3/users/e09166cc0dce4313a6fa0fba49fd09e9` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:26.541007 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09166cc0dce4313a6fa0fba49fd09e9)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:26.542966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:26.586962 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09166cc0dce4313a6fa0fba49fd09e9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:26.593446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09166cc0dce4313a6fa0fba49fd09e9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:26.594103 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09166cc0dce4313a6fa0fba49fd09e9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:26.609913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09166cc0dce4313a6fa0fba49fd09e9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:26.610539 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09166cc0dce4313a6fa0fba49fd09e9'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:26.623475 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1394/2798] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:26 2022] DELETE /identity/v3/users/e09166cc0dce4313a6fa0fba49fd09e9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:26.628233 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:26.628716 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:26.628824 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:26.674785 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:26.675937 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:26.733438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1405/2799] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:26.743028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:26.744410 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:26.836866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866f248-c5a4-4153-a848-d15dfea87ea6 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:26.840476 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:26.841113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:26.841395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:26.841670 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:26.850685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:26.852111 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:26.861308 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1395/2800] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:27.115457 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:27.117461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:27.131638 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ed8cd-87d3-4acf-994c-4ed8c002d0ff None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:27.137806 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:27.138690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:27.138932 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:27.139243 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] PATH_INFO: `/v3/projects/b0f5e16bf34e43848314de4c3bd26af6` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:27.140370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f5e16bf34e43848314de4c3bd26af6)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:27.142412 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:27.187238 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f5e16bf34e43848314de4c3bd26af6', 'request_id': 'req-32a43afa-a839-4c80-bf3f-ae5a371e1528'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.194811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f5e16bf34e43848314de4c3bd26af6', 'request_id': 'req-32a43afa-a839-4c80-bf3f-ae5a371e1528'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.200929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f5e16bf34e43848314de4c3bd26af6', 'request_id': 'req-32a43afa-a839-4c80-bf3f-ae5a371e1528'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.210718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] The token cache is being invalidate because project b0f5e16bf34e43848314de4c3bd26af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:27.210997 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.211622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.213141 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1406/2801] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:27 2022] DELETE /identity/v3/projects/b0f5e16bf34e43848314de4c3bd26af6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:27.217210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:27.227092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10cedf-8298-404a-9139-d96e7f997489 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:27.281648 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:27.282526 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:27.282811 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:27.283087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] PATH_INFO: `/v3/users/07c5eaedb5ec4fbd8a811d540ebfc539` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:27.284275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c5eaedb5ec4fbd8a811d540ebfc539)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:27.286224 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:27.329225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c5eaedb5ec4fbd8a811d540ebfc539'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.336380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c5eaedb5ec4fbd8a811d540ebfc539'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.337033 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c5eaedb5ec4fbd8a811d540ebfc539'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.348453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c5eaedb5ec4fbd8a811d540ebfc539'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.349073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-3b6e1d5a-7216-4a9e-9e00-adcfa586a41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c5eaedb5ec4fbd8a811d540ebfc539'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.362441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1396/2802] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:27 2022] DELETE /identity/v3/users/07c5eaedb5ec4fbd8a811d540ebfc539 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:27.630931 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:27.632504 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:27.645865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a43afa-a839-4c80-bf3f-ae5a371e1528 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:27.707461 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:27.708345 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:27.708651 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:27.708925 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] PATH_INFO: `/v3/projects/597896feb15f4022a04020f81a046662` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:27.710352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=597896feb15f4022a04020f81a046662)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:27.712306 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:27.764428 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597896feb15f4022a04020f81a046662', 'request_id': 'req-06dd77be-d1a2-4064-b161-31ec3781ea6a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.771593 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597896feb15f4022a04020f81a046662', 'request_id': 'req-06dd77be-d1a2-4064-b161-31ec3781ea6a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.777865 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597896feb15f4022a04020f81a046662', 'request_id': 'req-06dd77be-d1a2-4064-b161-31ec3781ea6a'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.788525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] The token cache is being invalidate because project 597896feb15f4022a04020f81a046662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:27.788808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.789433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-06dd77be-d1a2-4064-b161-31ec3781ea6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:27.791167 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1407/2803] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:27 2022] DELETE /identity/v3/projects/597896feb15f4022a04020f81a046662 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:27.797024 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ecf6e-ac57-4dba-9b6e-423c54399913 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:27.797494 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ecf6e-ac57-4dba-9b6e-423c54399913 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:27.797612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ecf6e-ac57-4dba-9b6e-423c54399913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:27.843110 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-d25ecf6e-ac57-4dba-9b6e-423c54399913 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:27.844277 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d25ecf6e-ac57-4dba-9b6e-423c54399913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:27.901393 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1397/2804] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 11:57:27.910178 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8515f3-9af9-4442-9739-835f6ea45837 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:27.910471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8515f3-9af9-4442-9739-835f6ea45837 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:27.910756 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8515f3-9af9-4442-9739-835f6ea45837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:27.929348 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-db8515f3-9af9-4442-9739-835f6ea45837 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:27.930568 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-db8515f3-9af9-4442-9739-835f6ea45837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:27.939036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1408/2805] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:27.943078 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ecf6e-ac57-4dba-9b6e-423c54399913 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:27.952944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ecf6e-ac57-4dba-9b6e-423c54399913 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:27.957428 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:27.958099 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:27.958376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:27.958647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:27.959358 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:57:27.959661 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:27.961239 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:27.972227 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1398/2806] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:57:27.976611 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8515f3-9af9-4442-9739-835f6ea45837 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:27.985295 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8515f3-9af9-4442-9739-835f6ea45837 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:27.989894 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:27.990522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:27.990801 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:27.991583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:27.992273 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:27.994189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.019577 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1409/2807] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:57:27 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:57:28.023685 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.033419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bed7e6-a25a-45b1-94ec-29e4a5ecbe92 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.089081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.089774 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.090087 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.090365 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.091054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.093004 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.112156 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1399/2808] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:57:28 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:28.116721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.126655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061c804-4a2d-4a61-98d5-e04b08f7807b admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.131192 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.132448 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.132729 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.133026 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.133771 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.135347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.145265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1410/2809] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:28.149546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.159272 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb2780-cada-42f4-8f46-a567ef39aab9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.164544 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50c1c1-cf1f-4489-a49e-d6c686ede545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.165187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c1c1-cf1f-4489-a49e-d6c686ede545 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.165472 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c1c1-cf1f-4489-a49e-d6c686ede545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.165788 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c1c1-cf1f-4489-a49e-d6c686ede545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.166507 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c1c1-cf1f-4489-a49e-d6c686ede545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.168088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c1c1-cf1f-4489-a49e-d6c686ede545 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.177695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1400/2810] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:28.181718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.191422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1934b3c-71d4-4e2f-8bd8-8c634db5ecec admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.196197 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.197090 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.197376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.197655 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] PATH_INFO: `/v3/projects/9b630b8e6dea4b28bca0699218ba41d0/users/3dabbad84fd14f5ebcfd00c0f5616989/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.212353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b630b8e6dea4b28bca0699218ba41d0, user_id=3dabbad84fd14f5ebcfd00c0f5616989, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.215097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.228525 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1411/2811] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:28 2022] PUT /identity/v3/projects/9b630b8e6dea4b28bca0699218ba41d0/users/3dabbad84fd14f5ebcfd00c0f5616989/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:28.238722 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff79e7-b940-446c-9ea6-f48a861e0345 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.239020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff79e7-b940-446c-9ea6-f48a861e0345 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.239304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff79e7-b940-446c-9ea6-f48a861e0345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.265379 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-7dff79e7-b940-446c-9ea6-f48a861e0345 None None] MFA Rules not processed for user `3dabbad84fd14f5ebcfd00c0f5616989`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:28.266612 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-7dff79e7-b940-446c-9ea6-f48a861e0345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:28.329875 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1401/2812] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:28.334319 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.399609 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777113d-afa2-4e0a-95f0-f2d112b7ea1c admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.405232 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.405965 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.406245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.406519 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.407517 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.409814 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.439681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1412/2813] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:57:28 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:28.440918 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff79e7-b940-446c-9ea6-f48a861e0345 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.452412 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff79e7-b940-446c-9ea6-f48a861e0345 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.509870 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.510536 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.510821 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.511091 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.511773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.513659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.533196 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1402/2814] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:57:28 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:28.537284 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.548317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5e64f-4393-49de-aa84-a948a5e5f269 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.553166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.554489 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.554876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.555245 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.556045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.557742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.571103 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1413/2815] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:28.575003 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.584817 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3047-cbe9-4953-b12f-fce7e7d9668a admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.589392 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbe7d-98f8-4212-91f2-6752b47cb881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.590082 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbe7d-98f8-4212-91f2-6752b47cb881 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.590369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbe7d-98f8-4212-91f2-6752b47cb881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.590647 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbe7d-98f8-4212-91f2-6752b47cb881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.591376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbe7d-98f8-4212-91f2-6752b47cb881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.592968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbe7d-98f8-4212-91f2-6752b47cb881 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.603389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1403/2816] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:28.607252 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.617510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990a5b-edb5-4d42-ba1a-b2f052002b3e admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.622169 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.623035 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.623318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.623592 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] PATH_INFO: `/v3/projects/122bc10f4f114b9ba56743e7428d57eb/users/776cf77f6446462099217add5b49c9a1/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.637605 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=122bc10f4f114b9ba56743e7428d57eb, user_id=776cf77f6446462099217add5b49c9a1, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.640311 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.653417 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1414/2817] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:28 2022] PUT /identity/v3/projects/122bc10f4f114b9ba56743e7428d57eb/users/776cf77f6446462099217add5b49c9a1/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:28.663964 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6eac-644a-401a-bacf-97a9b727f8e0 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.664293 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6eac-644a-401a-bacf-97a9b727f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.664474 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6eac-644a-401a-bacf-97a9b727f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.690868 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-b77b6eac-644a-401a-bacf-97a9b727f8e0 None None] MFA Rules not processed for user `776cf77f6446462099217add5b49c9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:28.692081 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-b77b6eac-644a-401a-bacf-97a9b727f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:28.753563 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1404/2818] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:28.757911 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.818152 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5588c-d3f5-41f3-b48e-0c2d36debfef admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.823351 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.823998 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.824281 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.824558 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.825267 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.827265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.851799 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1415/2819] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:57:28 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:57:28.855855 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b6eac-644a-401a-bacf-97a9b727f8e0 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.866867 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b6eac-644a-401a-bacf-97a9b727f8e0 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.922023 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.922678 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.922961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.923235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] PATH_INFO: `/v3/users` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.923921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.925850 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.945419 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1405/2820] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:57:28 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:57:28.949353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.959414 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb655e1-881a-4c7c-aac8-a2f58e5b4b80 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.964133 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.964788 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.965098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.965376 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:28.966135 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:28.967757 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:28.978464 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1416/2821] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:28.982333 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:28.992413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2a8b-a7a3-449b-ba3a-0c7f5fd2ebaf admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:28.996919 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:28.997814 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:28.998097 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:28.998372 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] PATH_INFO: `/v3/projects/afbdc4856f7143349181d2c9ca887937/users/0efafaad9c2e4c6ebba6ff6704f81601/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:29.013000 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbdc4856f7143349181d2c9ca887937, user_id=0efafaad9c2e4c6ebba6ff6704f81601, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:29.015604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:29.027924 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1406/2822] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:28 2022] PUT /identity/v3/projects/afbdc4856f7143349181d2c9ca887937/users/0efafaad9c2e4c6ebba6ff6704f81601/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:57:29.031739 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:29.041847 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83430402-7fe4-4ca1-a612-7df3771ec4ea admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:29.095975 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e7e21-5aef-4809-9bcb-a9afc28c9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:29.096625 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e7e21-5aef-4809-9bcb-a9afc28c9109 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:29.096909 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e7e21-5aef-4809-9bcb-a9afc28c9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:29.097206 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e7e21-5aef-4809-9bcb-a9afc28c9109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:29.097955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e7e21-5aef-4809-9bcb-a9afc28c9109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:29.099805 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e7e21-5aef-4809-9bcb-a9afc28c9109 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:29.109910 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1417/2823] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:29.114567 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:29.125069 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc1f3-6c5d-42b4-bd97-feba9b930b20 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:29.134460 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:29.135350 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:29.135635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:29.135913 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] PATH_INFO: `/v3/projects/afbdc4856f7143349181d2c9ca887937/users/0efafaad9c2e4c6ebba6ff6704f81601/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:29.137941 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbdc4856f7143349181d2c9ca887937, user_id=0efafaad9c2e4c6ebba6ff6704f81601, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:29.140619 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:29.151408 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1407/2824] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:29 2022] PUT /identity/v3/projects/afbdc4856f7143349181d2c9ca887937/users/0efafaad9c2e4c6ebba6ff6704f81601/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 11:57:29.162216 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:29.162509 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:29.162791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:29.189636 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] MFA Rules not processed for user `0efafaad9c2e4c6ebba6ff6704f81601`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:29.190893 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:29.256005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1418/2825] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:29.267845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:29.269562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:29.324629 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4046436-0cd5-4325-98f5-acb2e85ccfe2 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:29.328190 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58955a-e191-4116-8ba0-71dff58a85f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:29.328815 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58955a-e191-4116-8ba0-71dff58a85f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:29.329093 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58955a-e191-4116-8ba0-71dff58a85f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:29.329364 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58955a-e191-4116-8ba0-71dff58a85f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:29.338763 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58955a-e191-4116-8ba0-71dff58a85f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:29.340203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58955a-e191-4116-8ba0-71dff58a85f7 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:29.349676 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1408/2826] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:29.391535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:29.392900 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:29.404615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739c40c-a01b-42fb-8cbc-5fde3d64b875 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:29.408230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:29.408859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:29.409143 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:29.409422 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:29.464353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:29.465929 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:29.474800 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1419/2827] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:31.909141 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c9a08-a7a3-428f-87eb-60720cbdaa4b None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:31.909641 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c9a08-a7a3-428f-87eb-60720cbdaa4b None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:31.909866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c9a08-a7a3-428f-87eb-60720cbdaa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:31.927543 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-998c9a08-a7a3-428f-87eb-60720cbdaa4b None None] MFA Rules not processed for user `f6b3ad012ab1404b88e4b36c80a02a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:31.929287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-998c9a08-a7a3-428f-87eb-60720cbdaa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:31.983436 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1409/2828] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:32.376698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:32.438949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e46544-c804-4a70-a24d-b5d668f55750 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:32.445272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:32.446172 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:32.446458 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:32.446730 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] PATH_INFO: `/v3/users/3dabbad84fd14f5ebcfd00c0f5616989` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:32.447956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dabbad84fd14f5ebcfd00c0f5616989)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:32.449938 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:32.500242 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dabbad84fd14f5ebcfd00c0f5616989'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:32.508256 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dabbad84fd14f5ebcfd00c0f5616989'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:32.509451 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dabbad84fd14f5ebcfd00c0f5616989'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:32.521269 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dabbad84fd14f5ebcfd00c0f5616989'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:32.521996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dabbad84fd14f5ebcfd00c0f5616989'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:32.534808 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1420/2829] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:32 2022] DELETE /identity/v3/users/3dabbad84fd14f5ebcfd00c0f5616989 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:32.540065 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:32.540356 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:32.540635 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:32.558287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:32.559389 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:32.623157 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1410/2830] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:32.632972 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:32.634393 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:32.695846 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489573-1eba-4a9f-a108-a5fdb4b1567f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:32.700554 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:32.701209 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:32.701490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:32.701784 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:32.713595 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:32.715006 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:32.725396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1421/2831] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:33.031043 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:33.032621 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:33.045500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da9ecb-08ed-4af3-8aa5-4f1cd57acabb None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:33.051866 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:33.052930 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:33.053291 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:33.053587 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] PATH_INFO: `/v3/projects/9b630b8e6dea4b28bca0699218ba41d0` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:33.055764 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b630b8e6dea4b28bca0699218ba41d0)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:33.057769 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:33.105504 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b630b8e6dea4b28bca0699218ba41d0', 'request_id': 'req-222c3111-d1f7-4953-b66d-5e326cac9d49'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.112950 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b630b8e6dea4b28bca0699218ba41d0', 'request_id': 'req-222c3111-d1f7-4953-b66d-5e326cac9d49'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.120030 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b630b8e6dea4b28bca0699218ba41d0', 'request_id': 'req-222c3111-d1f7-4953-b66d-5e326cac9d49'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.130800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] The token cache is being invalidate because project 9b630b8e6dea4b28bca0699218ba41d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:33.131092 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.131727 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.133966 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1411/2832] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:33 2022] DELETE /identity/v3/projects/9b630b8e6dea4b28bca0699218ba41d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:33.137775 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:33.147580 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280d32e-510a-4fa6-807b-6fd959b2827f service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:33.202944 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:33.203815 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:33.204098 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:33.204371 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] PATH_INFO: `/v3/users/776cf77f6446462099217add5b49c9a1` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:33.205566 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776cf77f6446462099217add5b49c9a1)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:33.207545 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:33.253690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776cf77f6446462099217add5b49c9a1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.261644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776cf77f6446462099217add5b49c9a1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.262647 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776cf77f6446462099217add5b49c9a1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.274795 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776cf77f6446462099217add5b49c9a1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.275454 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776cf77f6446462099217add5b49c9a1'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.287913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1422/2833] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:33 2022] DELETE /identity/v3/users/776cf77f6446462099217add5b49c9a1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:33.552942 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:33.554378 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:33.573013 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c3111-d1f7-4953-b66d-5e326cac9d49 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:33.635287 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:33.636490 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:33.636996 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:33.637477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] PATH_INFO: `/v3/projects/122bc10f4f114b9ba56743e7428d57eb` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:33.638946 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122bc10f4f114b9ba56743e7428d57eb)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:33.641054 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:33.693313 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122bc10f4f114b9ba56743e7428d57eb', 'request_id': 'req-a858e6b8-e3ee-422a-8b77-3b7ebf871208'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.703257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122bc10f4f114b9ba56743e7428d57eb', 'request_id': 'req-a858e6b8-e3ee-422a-8b77-3b7ebf871208'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.710975 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122bc10f4f114b9ba56743e7428d57eb', 'request_id': 'req-a858e6b8-e3ee-422a-8b77-3b7ebf871208'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.722839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] The token cache is being invalidate because project 122bc10f4f114b9ba56743e7428d57eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:33.722839 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.723712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.728656 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1412/2834] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:33 2022] DELETE /identity/v3/projects/122bc10f4f114b9ba56743e7428d57eb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:33.729947 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:33.731528 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:33.745482 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482579-657b-4944-a84d-a5ac246d6567 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:33.810505 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:33.811427 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:33.811690 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:33.811969 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] PATH_INFO: `/v3/users/0efafaad9c2e4c6ebba6ff6704f81601` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:33.813579 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efafaad9c2e4c6ebba6ff6704f81601)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:33.815377 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:33.878684 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efafaad9c2e4c6ebba6ff6704f81601'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.886993 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efafaad9c2e4c6ebba6ff6704f81601'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.887836 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efafaad9c2e4c6ebba6ff6704f81601'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.900895 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efafaad9c2e4c6ebba6ff6704f81601'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.901736 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-45a995e9-6488-4283-a359-9de98a904dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efafaad9c2e4c6ebba6ff6704f81601'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:33.914698 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1423/2835] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:33 2022] DELETE /identity/v3/users/0efafaad9c2e4c6ebba6ff6704f81601 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:34.192684 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:34.195335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:34.218639 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858e6b8-e3ee-422a-8b77-3b7ebf871208 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:34.281573 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:34.282569 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.282838 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.283335 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] PATH_INFO: `/v3/projects/afbdc4856f7143349181d2c9ca887937` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.284387 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbdc4856f7143349181d2c9ca887937)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:34.287119 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:34.341088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbdc4856f7143349181d2c9ca887937', 'request_id': 'req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:34.350337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbdc4856f7143349181d2c9ca887937', 'request_id': 'req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:34.357967 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbdc4856f7143349181d2c9ca887937', 'request_id': 'req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:34.383260 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] The token cache is being invalidate because project afbdc4856f7143349181d2c9ca887937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:34.383562 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:34.384242 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-17fbc6ff-dfbd-49db-b053-eb204d9b4bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:34.386169 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1413/2836] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:34 2022] DELETE /identity/v3/projects/afbdc4856f7143349181d2c9ca887937 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:34.392374 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2fb2-2640-49ea-99c6-b278b0234ea0 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.393185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2fb2-2640-49ea-99c6-b278b0234ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.393185 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2fb2-2640-49ea-99c6-b278b0234ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.418328 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-b1fd2fb2-2640-49ea-99c6-b278b0234ea0 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:34.420088 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b1fd2fb2-2640-49ea-99c6-b278b0234ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:34.489737 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1424/2837] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:34.498414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb9c0-f964-4bff-8058-937c69ca0b09 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.498938 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb9c0-f964-4bff-8058-937c69ca0b09 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.499317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb9c0-f964-4bff-8058-937c69ca0b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.524935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-bcecb9c0-f964-4bff-8058-937c69ca0b09 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:34.526275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-bcecb9c0-f964-4bff-8058-937c69ca0b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:34.535216 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1414/2838] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:34.539285 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2fb2-2640-49ea-99c6-b278b0234ea0 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:34.549748 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2fb2-2640-49ea-99c6-b278b0234ea0 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:34.556155 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:34.556842 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.557126 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.557406 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.558202 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:57:34.558513 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:34.560134 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:34.572310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1425/2839] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:57:34.576730 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecb9c0-f964-4bff-8058-937c69ca0b09 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:34.586448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecb9c0-f964-4bff-8058-937c69ca0b09 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:34.591235 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:34.591997 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.592347 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.592695 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.593457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:34.595453 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:34.628311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1415/2840] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:57:34 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:34.636234 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:34.655622 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1ae16-b2c4-4da5-9d54-ff737a5fa6b8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:34.723021 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:34.724097 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.724386 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.724666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.725362 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:34.728957 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:34.753750 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1426/2841] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:57:34 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:34.757743 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:34.768968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78dff-d41b-4d71-a450-fef1a904940f admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:34.775036 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:34.775696 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.775981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.776257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.777029 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:34.778677 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:34.791219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1416/2842] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:34.795413 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:34.805742 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd0bc-9304-4126-8638-6b398ccf27d5 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:34.810751 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dbbee-5bc5-459c-8c82-4bafec48b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:34.811526 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dbbee-5bc5-459c-8c82-4bafec48b7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.811817 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dbbee-5bc5-459c-8c82-4bafec48b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.812092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dbbee-5bc5-459c-8c82-4bafec48b7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.812818 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dbbee-5bc5-459c-8c82-4bafec48b7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:34.814644 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dbbee-5bc5-459c-8c82-4bafec48b7b2 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:34.827438 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1427/2843] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:57:34.831565 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:34.842193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe15ea-7140-4aaa-b034-f155c9f753af admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:34.846903 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:34.847778 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.848058 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.848334 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] PATH_INFO: `/v3/projects/88694086c86f456cb5174f47f5ac53d6/users/8ec3eb24e27f465292a6475c1ac9a50d/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.863974 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88694086c86f456cb5174f47f5ac53d6, user_id=8ec3eb24e27f465292a6475c1ac9a50d, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:34.867133 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:34.884834 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1417/2844] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:34 2022] PUT /identity/v3/projects/88694086c86f456cb5174f47f5ac53d6/users/8ec3eb24e27f465292a6475c1ac9a50d/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:34.891318 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93826f01-199a-4d3d-bd9f-81980f22e7f5 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:34.891602 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93826f01-199a-4d3d-bd9f-81980f22e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:34.891897 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93826f01-199a-4d3d-bd9f-81980f22e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:34.934157 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-93826f01-199a-4d3d-bd9f-81980f22e7f5 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:34.935401 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-93826f01-199a-4d3d-bd9f-81980f22e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:35.014297 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1428/2845] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:35.020904 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:35.032318 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:35.109314 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a4b6-cfaa-4508-9e08-785097bd6166 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:35.113793 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:35.114524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:35.115012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:35.115506 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:35.128659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:35.130245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:35.142841 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1418/2846] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:35.820275 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42737f-16f1-403d-960b-c9c4b1d881d9 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:35.820829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42737f-16f1-403d-960b-c9c4b1d881d9 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:35.820829 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42737f-16f1-403d-960b-c9c4b1d881d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:35.846926 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-3a42737f-16f1-403d-960b-c9c4b1d881d9 None None] MFA Rules not processed for user `8ec3eb24e27f465292a6475c1ac9a50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:35.848149 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-3a42737f-16f1-403d-960b-c9c4b1d881d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:35.912317 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1429/2847] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:35.917203 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:35.926471 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225a1a0-1c52-4599-a61b-4bca2fd8ad62 service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:35.931518 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:35.932152 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:35.932432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:35.932720 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:35.933396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:35.935340 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:35.961040 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1419/2848] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:57:35 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:35.965001 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42737f-16f1-403d-960b-c9c4b1d881d9 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:35.976163 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42737f-16f1-403d-960b-c9c4b1d881d9 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:36.037524 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:36.038734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:36.039014 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:36.039315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:36.039992 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:36.041936 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:36.061919 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1430/2849] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:57:35 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:36.066384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:36.076319 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68c57d-1032-4f09-9fe3-5c1ef5fb44d9 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:36.081220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:36.081894 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:36.082178 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:36.082457 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:36.083181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:36.084760 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:36.095414 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1420/2850] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:36.099811 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:36.110040 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea1e1-dc81-4173-b99c-492ce18298f8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:36.114721 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:36.115583 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:36.115861 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:36.116132 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] PATH_INFO: `/v3/projects/803c1f00125d41ce8b9fae53c5a40646/users/42a125f03df54ae291e9893551dc3171/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:36.130977 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803c1f00125d41ce8b9fae53c5a40646, user_id=42a125f03df54ae291e9893551dc3171, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:36.133733 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:36.148189 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1431/2851] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:36 2022] PUT /identity/v3/projects/803c1f00125d41ce8b9fae53c5a40646/users/42a125f03df54ae291e9893551dc3171/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:36.152201 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:36.162125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c342ee-bcf8-4851-9a7c-27fef4597eed admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:36.221927 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed04d25-ccf1-45f4-9852-5906b55ffa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:36.222604 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04d25-ccf1-45f4-9852-5906b55ffa74 admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:36.222887 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04d25-ccf1-45f4-9852-5906b55ffa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:36.223204 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04d25-ccf1-45f4-9852-5906b55ffa74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:36.224210 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed04d25-ccf1-45f4-9852-5906b55ffa74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:36.226492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed04d25-ccf1-45f4-9852-5906b55ffa74 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:36.237487 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1421/2852] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:36.240844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:36.251399 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf77d-9131-43d9-adec-97c5e85db9a8 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:36.256129 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:36.257869 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:36.258324 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:36.258752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] PATH_INFO: `/v3/projects/803c1f00125d41ce8b9fae53c5a40646/users/42a125f03df54ae291e9893551dc3171/roles/714f5eae52e240ca9b09d49c36f10b2f` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:36.260923 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=803c1f00125d41ce8b9fae53c5a40646, user_id=42a125f03df54ae291e9893551dc3171, role_id=714f5eae52e240ca9b09d49c36f10b2f)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:36.263749 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:36.274272 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1432/2853] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:36 2022] PUT /identity/v3/projects/803c1f00125d41ce8b9fae53c5a40646/users/42a125f03df54ae291e9893551dc3171/roles/714f5eae52e240ca9b09d49c36f10b2f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:36.876089 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:36.876477 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:36.876826 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:36.903740 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] MFA Rules not processed for user `42a125f03df54ae291e9893551dc3171`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:36.905073 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:36.972455 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1422/2854] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:36.985347 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:36.987200 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:37.042968 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754330e6-1a01-46d2-9b54-96e744decf3f admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:37.046879 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:37.047626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:37.047913 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:37.048207 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:37.106459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:37.106459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:37.114012 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1433/2855] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:38.448288 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:38.449748 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:38.462193 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c6219-6f43-4132-abce-1da4cf1a5ced None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:38.465738 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:38.466376 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:38.466659 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:38.466935 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:38.476615 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:38.478066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:38.487240 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1423/2856] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:51.717712 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:51.786222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d60f-0b96-423b-afb0-bf5958ee1da3 service cinder] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:51.791312 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:51.792177 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:51.792459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:51.792734 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] PATH_INFO: `/v3/users/8ec3eb24e27f465292a6475c1ac9a50d` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:51.794005 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec3eb24e27f465292a6475c1ac9a50d)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:51.796120 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:51.847250 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec3eb24e27f465292a6475c1ac9a50d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:51.855597 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec3eb24e27f465292a6475c1ac9a50d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:51.856564 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec3eb24e27f465292a6475c1ac9a50d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:51.873774 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec3eb24e27f465292a6475c1ac9a50d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:51.874492 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec3eb24e27f465292a6475c1ac9a50d'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:51.893353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1434/2857] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:51 2022] DELETE /identity/v3/users/8ec3eb24e27f465292a6475c1ac9a50d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:52.059944 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:52.072109 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98ee17-f450-4866-ba7e-490c48889f95 service cinder] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:52.128951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:52.130516 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.130933 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.131214 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] PATH_INFO: `/v3/projects/88694086c86f456cb5174f47f5ac53d6` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.133275 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88694086c86f456cb5174f47f5ac53d6)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:52.136280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:52.182413 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88694086c86f456cb5174f47f5ac53d6', 'request_id': 'req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.189448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88694086c86f456cb5174f47f5ac53d6', 'request_id': 'req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.196151 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88694086c86f456cb5174f47f5ac53d6', 'request_id': 'req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.205961 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] The token cache is being invalidate because project 88694086c86f456cb5174f47f5ac53d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:52.206245 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.206864 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.208380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1424/2858] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:52 2022] DELETE /identity/v3/projects/88694086c86f456cb5174f47f5ac53d6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:52.212370 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:52.213859 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:52.227049 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85c284-cadb-46c7-b860-b8f657730578 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:52.281615 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:52.282510 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.282794 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.283069 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] PATH_INFO: `/v3/users/42a125f03df54ae291e9893551dc3171` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.284265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a125f03df54ae291e9893551dc3171)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:52.286226 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:52.330681 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a125f03df54ae291e9893551dc3171'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.338432 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a125f03df54ae291e9893551dc3171'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.339050 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a125f03df54ae291e9893551dc3171'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.350908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a125f03df54ae291e9893551dc3171'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.351582 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-f98fd016-d1b8-48dc-bd77-06532e901587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a125f03df54ae291e9893551dc3171'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.363222 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1435/2859] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:52 2022] DELETE /identity/v3/users/42a125f03df54ae291e9893551dc3171 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:52.533228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:52.535096 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:52.549046 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbef23-852b-47f5-af55-2a7a06c2cf5d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:52.604557 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:52.605420 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.605723 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.606066 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] PATH_INFO: `/v3/projects/803c1f00125d41ce8b9fae53c5a40646` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.608321 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803c1f00125d41ce8b9fae53c5a40646)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:52.610497 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:52.655269 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803c1f00125d41ce8b9fae53c5a40646', 'request_id': 'req-a098f0e2-8444-4d25-89d1-9218c0371336'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.662257 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803c1f00125d41ce8b9fae53c5a40646', 'request_id': 'req-a098f0e2-8444-4d25-89d1-9218c0371336'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.668886 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803c1f00125d41ce8b9fae53c5a40646', 'request_id': 'req-a098f0e2-8444-4d25-89d1-9218c0371336'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.679113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] The token cache is being invalidate because project 803c1f00125d41ce8b9fae53c5a40646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:52.679401 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.680028 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-a098f0e2-8444-4d25-89d1-9218c0371336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:52.681561 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1425/2860] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:52 2022] DELETE /identity/v3/projects/803c1f00125d41ce8b9fae53c5a40646 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:52.686490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f840b2-d3a5-4294-8239-705e7eee190c None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.686779 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f840b2-d3a5-4294-8239-705e7eee190c None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.687051 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f840b2-d3a5-4294-8239-705e7eee190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.705153 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-53f840b2-d3a5-4294-8239-705e7eee190c None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:52.706402 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-53f840b2-d3a5-4294-8239-705e7eee190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:52.767486 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1436/2861] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:52.775928 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19732c-fb22-42d8-81e2-b83f7d53fe36 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.776219 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19732c-fb22-42d8-81e2-b83f7d53fe36 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.776500 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19732c-fb22-42d8-81e2-b83f7d53fe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.796395 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9b19732c-fb22-42d8-81e2-b83f7d53fe36 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:52.797591 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9b19732c-fb22-42d8-81e2-b83f7d53fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:52.808491 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1426/2862] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:52.809916 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f840b2-d3a5-4294-8239-705e7eee190c None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:52.819398 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f840b2-d3a5-4294-8239-705e7eee190c None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:52.824013 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:52.824671 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.824955 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.825235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] PATH_INFO: `/v3/domains` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.826023 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 11:57:52.826329 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:52.832353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:52.845672 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1437/2863] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 12 11:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 11:57:52.850311 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19732c-fb22-42d8-81e2-b83f7d53fe36 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:52.859994 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19732c-fb22-42d8-81e2-b83f7d53fe36 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:52.864572 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:52.865220 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.865502 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.865820 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.866515 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:52.868958 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:52.894446 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1427/2864] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 12 11:57:52 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 11:57:52.898759 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:52.908642 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d368c7-1593-4969-8a5d-a9a7678c6220 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:52.961886 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:52.962535 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:52.962840 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:52.963108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] PATH_INFO: `/v3/users` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:52.963783 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:52.965717 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:52.986497 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1438/2865] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 12 11:57:52 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 11:57:52.993237 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:53.004488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e96a9-f51a-45a9-a56b-38559c0bb813 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:53.009712 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:53.010380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:53.010663 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:53.010940 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:53.011665 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:53.013837 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:53.025448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1428/2866] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 11:57:53.029962 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:53.041666 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb409a-288e-46a0-b5a8-8c4d14e6696a admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:53.046268 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a9058-3a96-4581-a9b7-cd3ba956f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:53.046976 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9058-3a96-4581-a9b7-cd3ba956f291 admin admin] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:53.047265 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9058-3a96-4581-a9b7-cd3ba956f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:53.047542 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9058-3a96-4581-a9b7-cd3ba956f291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:53.048353 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a9058-3a96-4581-a9b7-cd3ba956f291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:53.050130 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a9058-3a96-4581-a9b7-cd3ba956f291 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:53.060645 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1439/2867] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 12 11:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 11:57:53.064751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:53.074432 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4dbe8-982a-4bd3-ad97-5b5e398943ad admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:53.078986 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:53.079845 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:53.080123 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:53.080396 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] PATH_INFO: `/v3/projects/4b8a9dffd5f142d0ab678e725d848625/users/5f3923d94e524e73b8297530db6569f0/roles/4f6317917e894e6eb35b5ac8f7ca0b64` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:53.094183 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8a9dffd5f142d0ab678e725d848625, user_id=5f3923d94e524e73b8297530db6569f0, role_id=4f6317917e894e6eb35b5ac8f7ca0b64)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:53.096809 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:53.109556 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1429/2868] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 12 11:57:53 2022] PUT /identity/v3/projects/4b8a9dffd5f142d0ab678e725d848625/users/5f3923d94e524e73b8297530db6569f0/roles/4f6317917e894e6eb35b5ac8f7ca0b64 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:53.170433 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4dc0-af06-4cb1-9b81-5e33a42b91a2 None None] REQUEST_METHOD: `POST` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:53.170720 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4dc0-af06-4cb1-9b81-5e33a42b91a2 None None] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:53.170996 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4dc0-af06-4cb1-9b81-5e33a42b91a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:53.196967 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.auth.core [None req-a0af4dc0-af06-4cb1-9b81-5e33a42b91a2 None None] MFA Rules not processed for user `5f3923d94e524e73b8297530db6569f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:53.198249 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a0af4dc0-af06-4cb1-9b81-5e33a42b91a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:53.259147 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1440/2869] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:53.269555 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:53.271250 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:53.326232 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b334635-f498-4eca-8448-06ceca29c61d admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:53.329753 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86128005-f447-4967-837a-8274c9d4f18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd990142782ed4f2f92e51c2a76693009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:53.330380 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86128005-f447-4967-837a-8274c9d4f18e service cinder] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:53.330658 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86128005-f447-4967-837a-8274c9d4f18e service cinder] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:53.330926 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86128005-f447-4967-837a-8274c9d4f18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:53.338914 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86128005-f447-4967-837a-8274c9d4f18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:53.340348 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86128005-f447-4967-837a-8274c9d4f18e service cinder] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:53.348789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1430/2870] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:56.312046 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af4dc0-af06-4cb1-9b81-5e33a42b91a2 None None] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:56.372856 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af4dc0-af06-4cb1-9b81-5e33a42b91a2 None None] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:56.377430 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:56.378331 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:56.378640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:56.378914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] PATH_INFO: `/v3/users/5f3923d94e524e73b8297530db6569f0` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:56.380128 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3923d94e524e73b8297530db6569f0)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:56.382115 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:56.423890 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3923d94e524e73b8297530db6569f0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.431471 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3923d94e524e73b8297530db6569f0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.432230 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3923d94e524e73b8297530db6569f0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.443705 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3923d94e524e73b8297530db6569f0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.444359 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3923d94e524e73b8297530db6569f0'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.456951 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1441/2871] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 11:57:56 2022] DELETE /identity/v3/users/5f3923d94e524e73b8297530db6569f0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:57:56.461524 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:56.462020 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:56.462135 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:56.478756 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] MFA Rules not processed for user `9c5320af9c1c4a2f890e539109dfa042`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:57:56.479953 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:56.536728 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1431/2872] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:57:56.546548 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:56.547876 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:56.604956 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ba803-89dc-416a-81d7-e1e8a5cdf1b9 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:56.608626 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:56.609271 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:56.609555 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:56.609867 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:56.619459 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:56.620903 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:56.630293 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1442/2873] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:57:56.897644 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:57:56.900338 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:57:56.912761 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2725c-87b5-4b31-a880-03202929a935 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:57:56.917608 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:57:56.918492 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:57:56.918773 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:57:56.919181 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] PATH_INFO: `/v3/projects/4b8a9dffd5f142d0ab678e725d848625` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:57:56.920225 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8a9dffd5f142d0ab678e725d848625)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:57:56.922145 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:57:56.967448 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8a9dffd5f142d0ab678e725d848625', 'request_id': 'req-bd6c54de-1b4a-4049-8b2f-cffcf2227605'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.973782 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8a9dffd5f142d0ab678e725d848625', 'request_id': 'req-bd6c54de-1b4a-4049-8b2f-cffcf2227605'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.980800 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8a9dffd5f142d0ab678e725d848625', 'request_id': 'req-bd6c54de-1b4a-4049-8b2f-cffcf2227605'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.990736 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] The token cache is being invalidate because project 4b8a9dffd5f142d0ab678e725d848625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 11:57:56.991018 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.991636 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-bd6c54de-1b4a-4049-8b2f-cffcf2227605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 11:57:56.993770 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1432/2874] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 11:57:56 2022] DELETE /identity/v3/projects/4b8a9dffd5f142d0ab678e725d848625 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 11:58:07.044791 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:58:07.046355 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:58:07.132663 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2625cbf-7cf4-4051-8d29-d878fde5963d service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:58:07.190235 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:58:07.190883 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:58:07.191165 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:58:07.191442 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:58:07.193215 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:58:07.204697 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:58:07.206321 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:58:07.215961 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1443/2875] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:58:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 11:59:24.539116 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdc091-a723-4695-a166-3dd69f34c164 None None] REQUEST_METHOD: `POST` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:59:24.539633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdc091-a723-4695-a166-3dd69f34c164 None None] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:59:24.539633 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdc091-a723-4695-a166-3dd69f34c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:59:24.556715 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.auth.core [None req-9abdc091-a723-4695-a166-3dd69f34c164 None None] MFA Rules not processed for user `f6b3ad012ab1404b88e4b36c80a02a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 11:59:24.557921 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-9abdc091-a723-4695-a166-3dd69f34c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:59:24.609265 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1433/2876] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 12 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 11:59:24.913981 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 11:59:24.915375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:59:24.969092 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424c05b-feba-4c33-865f-e85b5a035a50 service placement] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 11:59:24.972802 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 11:59:24.973439 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 11:59:24.973752 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 11:59:24.974036 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 11:59:24.975772 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 11:59:24.985718 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 11:59:24.987166 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 11:59:24.994917 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1444/2877] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 12:01:07.865654 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdc091-a723-4695-a166-3dd69f34c164 None None] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:07.875158 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdc091-a723-4695-a166-3dd69f34c164 None None] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:07.878762 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:07.879423 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:07.879706 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:07.879981 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:07.881751 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:07.891369 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:07.892789 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:07.901280 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1434/2878] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 12:01:13.987633 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:13.996299 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140f825-aca4-4166-8de1-2e7b1e2b17be service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:13.999935 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:14.000560 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:14.000844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:14.001118 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:14.002896 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:14.013334 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:14.014796 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:14.023908 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1445/2879] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 12:01:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 12:01:15.041486 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:15.042947 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:15.053852 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b6ea-e638-4b0e-9762-dc6da67dd62f service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:15.057549 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:15.058243 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:15.058522 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:15.058795 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:15.060595 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:15.147916 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:15.149337 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:15.169891 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1435/2880] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 12:01:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 12:01:16.346010 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:16.354608 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e07c-ec29-44fc-9eac-9df1df83b239 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:16.358203 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:16.358839 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:16.359122 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:16.359403 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:16.361162 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:16.375058 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:16.376496 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:16.388096 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1446/2881] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 12:01:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 12:01:17.148570 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:17.150304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:17.164012 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fea24-150c-425e-afb6-b66bb97bd93d service neutron] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:17.169692 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59372ef7ca2d439c8a2c12e29f8d97bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:17.170590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:17.170848 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:17.171120 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:17.173187 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:17.187298 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:17.188878 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:17.200122 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1436/2882] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 12:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 12:01:28.444292 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:28.457490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b260f-33f9-4e2b-800d-7bb6befe95df service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:28.457490 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1c4e1fe220486ab672b3dea6ffdfec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:28.457820 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] REQUEST_METHOD: `GET` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:28.458045 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:28.458315 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:28.460044 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:28.521327 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:28.522971 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:28.532639 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1447/2883] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 12:01:34.811441 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:34.813475 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:34.831104 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd0f36-cbcd-48dd-9737-5a0b71cee7fc service nova] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:34.835799 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:34.836668 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:34.836951 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:34.837228 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] PATH_INFO: `/v3/users/f6b3ad012ab1404b88e4b36c80a02a05` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:34.838968 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b3ad012ab1404b88e4b36c80a02a05)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:34.840922 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:34.894006 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b3ad012ab1404b88e4b36c80a02a05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:34.900846 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b3ad012ab1404b88e4b36c80a02a05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:34.901553 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b3ad012ab1404b88e4b36c80a02a05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:34.913560 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b3ad012ab1404b88e4b36c80a02a05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:34.914304 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b3ad012ab1404b88e4b36c80a02a05'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:34.927779 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1437/2884] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 12:01:34 2022] DELETE /identity/v3/users/f6b3ad012ab1404b88e4b36c80a02a05 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 12:01:35.097905 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:35.108640 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155217-9267-4aac-b7f6-45d36742c579 service neutron] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:35.163522 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:35.164375 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:35.164658 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:35.164934 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] PATH_INFO: `/v3/projects/7d148f892d044444b6be65537ba8b335` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:35.166139 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d148f892d044444b6be65537ba8b335)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:35.168034 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:35.212336 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d148f892d044444b6be65537ba8b335', 'request_id': 'req-a33d456b-c89e-40b5-b1d4-34c163f23b16'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.219407 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d148f892d044444b6be65537ba8b335', 'request_id': 'req-a33d456b-c89e-40b5-b1d4-34c163f23b16'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.225352 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d148f892d044444b6be65537ba8b335', 'request_id': 'req-a33d456b-c89e-40b5-b1d4-34c163f23b16'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.235694 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] The token cache is being invalidate because project 7d148f892d044444b6be65537ba8b335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 12:01:35.235914 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.236541 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.238093 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1448/2885] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 12:01:35 2022] DELETE /identity/v3/projects/7d148f892d044444b6be65537ba8b335 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 12:01:35.242088 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:35.243586 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:35.257983 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bfea8-6970-438e-9ec2-1c1b50a557ac admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:35.314713 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:35.315620 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:35.315902 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:35.316179 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] PATH_INFO: `/v3/users/3543d74e520d4d018c4c55b9f9bef7a7` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:35.317405 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3543d74e520d4d018c4c55b9f9bef7a7)` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:35.319384 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:35.365777 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3543d74e520d4d018c4c55b9f9bef7a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.372546 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3543d74e520d4d018c4c55b9f9bef7a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.373317 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3543d74e520d4d018c4c55b9f9bef7a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.384523 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3543d74e520d4d018c4c55b9f9bef7a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.385147 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.notifications [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3543d74e520d4d018c4c55b9f9bef7a7'} {{(pid=80120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.397113 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1438/2886] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 12 12:01:35 2022] DELETE /identity/v3/users/3543d74e520d4d018c4c55b9f9bef7a7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 12:01:35.570844 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Authenticating user token {{(pid=80119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:01:35.572244 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.fernet_utils [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:01:35.585860 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d456b-c89e-40b5-b1d4-34c163f23b16 admin admin] Validating token access rules against request {{(pid=80119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:01:35.642310 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c5320af9c1c4a2f890e539109dfa042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11860b8464634d7683ecba74bb161400', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:01:35.643108 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:01:35.643396 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:01:35.643675 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] PATH_INFO: `/v3/projects/67ec3f77ca454ea2a27dcdec90ebc859` {{(pid=80119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:01:35.644870 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ec3f77ca454ea2a27dcdec90ebc859)` {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:01:35.646835 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] RBAC: Authorization granted {{(pid=80119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:01:35.692858 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ec3f77ca454ea2a27dcdec90ebc859', 'request_id': 'req-39440122-3d79-4f9d-ae5a-660767d7f235'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.701254 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ec3f77ca454ea2a27dcdec90ebc859', 'request_id': 'req-39440122-3d79-4f9d-ae5a-660767d7f235'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.708877 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ec3f77ca454ea2a27dcdec90ebc859', 'request_id': 'req-39440122-3d79-4f9d-ae5a-660767d7f235'} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.720949 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] The token cache is being invalidate because project 67ec3f77ca454ea2a27dcdec90ebc859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 12:01:35.721231 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.721898 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: DEBUG keystone.notifications [None req-39440122-3d79-4f9d-ae5a-660767d7f235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 12:01:35.723686 dv-cinder-804735-29-iscsi devstack@keystone.service[80119]: [pid: 80119|app: 0|req: 1449/2887] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 12 12:01:35 2022] DELETE /identity/v3/projects/67ec3f77ca454ea2a27dcdec90ebc859 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 12:03:11.114585 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Authenticating user token {{(pid=80120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 12:03:11.116481 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:03:11.183488 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e35aa-dad1-4f3b-893d-10e42a54fdb6 admin admin] Validating token access rules against request {{(pid=80120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 12:03:11.239631 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebd3f4-566d-403e-9df2-6551e5222116 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6eb30499054f368f00f38c946d7c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1174d81ccf71439ebf50adeb716b4fac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 12:03:11.240843 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebd3f4-566d-403e-9df2-6551e5222116 service placement] REQUEST_METHOD: `GET` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 12:03:11.241060 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebd3f4-566d-403e-9df2-6551e5222116 service placement] SCRIPT_NAME: `/identity` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 12:03:11.241330 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebd3f4-566d-403e-9df2-6551e5222116 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 12:03:11.243125 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.fernet_utils [None req-5cebd3f4-566d-403e-9df2-6551e5222116 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 12:03:11.254016 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebd3f4-566d-403e-9df2-6551e5222116 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 12:03:11.255590 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebd3f4-566d-403e-9df2-6551e5222116 service placement] RBAC: Authorization granted {{(pid=80120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 12:03:11.265783 dv-cinder-804735-29-iscsi devstack@keystone.service[80120]: [pid: 80120|app: 0|req: 1439/2888] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 12 12:03:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)